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Middle School Classrooms: Teachers' Reported Practices and 

Student Perceptions 



Tonya R. Moon 
Carolyn M. Callahan 
Carol A. Tomlinson 
Erin M. Miller 
University of Virginia 
Charlottesville, Virginia 

ABSTRACT 



Middle school teachers' reported classroom practices, middle school students' perceptions 
of classroom practice, and the alignment of reported practices and perceptions with the 
middle school movement's orientation towards student achievement form the foci of this 
study. As part of a larger study looking at two different interventions for addressing the 
academic diversity of middle school learners (Callahan, Tomlinson, Moon, Brighton, & 
Hertberg, in preparation), teachers in participating schools were asked to complete a 
middle school practices survey. Students completed a parallel survey on their 
perceptions of their classrooms. In addition to reporting teacher and student responses to 
the surveys, comparisons between teacher reported practices and student perceptions as 
well as comparisons with the 1995 national study of middle school teacher practices 
(Moon, Tomlinson, & Callahan, 1995) are provided in this monograph. Examination of 
teacher practices and student perceptions in addressing academic diversity in middle 
school classrooms evolved from examining the literature on: (a) characteristics of middle 
school students, (b) student achievement goals in the middle school, (c) middle school 
curriculum, instruction and assessment practices, (d) accommodating academic diversity 
in the middle school classroom, and (e) student grouping. 

bindings replicate what was previously found in the 1995 NRC/GT study as well as 
provide unique findings relative to the particular interventions implemented as part of the 
larger NRC/GT study. Consistent with the 1995 study findings, teachers report that 
learning contracts, tiered assignments, advanced organizers, computer programs focusing 
on basic skills or advanced understanding, curriculum compacting, learning centers, 
flexible grouping, or interest centers are rarely used in their middle school classrooms. In 
contrast to the 1995 study findings, state curriculum standards, local curriculum guides, 
and key concepts and principles of core disciplines are considered the three most 
important factors in determining instructional content taught by teachers. 

Eludings unique to the study indicate the majority of teachers report using example 
activities and observations to modify the content of activities, types of products required 
of students, and student grouping arrangements; yet a large portion of teachers also 
indicate never tailoring an assignment for students or varying materials based on student 
readiness levels. Instead, lecture, direct instruction to the whole class using the state 
standards and local curriculum guides, is the predominant reported modality of teaching. 
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Students indicated, consistent with teachers' responses, that the instructional content of 
their classes was textbook driven and focused on student success for more formal 
assessments (e.g., end-of-unit tests, standardized tests). Students also indicated whole 
group instruction supported by note taking and all students working on the same 
assignment as the predominant format of their classrooms. 




Middle School Classrooms: Teachers' Reported Practices and 

Student Perceptions 

Tonya R. Moon 
Carolyn M. Callahan 
Carol A. Tomlinson 
Erin M. Miller 
University of Virginia 
Charlottesville, Virginia 

EXECUTIVE SUMMARY 



Review of the Literature 

One of the most pivotal concerns voiced in the literature on the middle school is 
the lack of academic rigor (Beane, 1999; Gallagher, Harradine, & Coleman, 1997; 
Tucker, & Codding, 1998; Williamson, Johnston, & Kanthak, 1995). Tucker and 
Codding (1998) recently called middle schools "the wasteland of our primary and 
secondary landscape" (p. 153). Specific criticisms concerning the lack of academic 
progress of middle school students include: 

• a lack of curricular focus on core academic courses and analytical skills 
leading students to focus away from school and even become alienated 
from it; 

• a lack of preparation for either high school or meaningful employment; 

• a dramatic increase in inflexible ability grouping as children enter middle 
school, restricting at-risk students' access to challenging curricula and 
contributing to subsequent low achievement (Ames, 1998; Argetsinger, 
1999; Carnegie Council on Adolescent Development, 1989; McEwin, 
Dickinson, & Jenkins, 1996). 

Some critics have suggested that overemphasizing social, psychological, physical, 
and emotional needs of middle school students has contributed to schools that do not 
academically challenge students. In apparent response to these criticisms, the most 
significant change in the 2000 edition of Turning Points is the designation of student 
success and achievement as the primary goal, and as a more important goal than any 
other recommendation made. Jackson and Davis (2000) explicitly stated, "Eet us be 
clear. The main purpose of middle grades education is to promote young adolescents' 
intellectual development" (p. 10). All other recommendations in Turning Points 2000, 
including those related to social and emotional development, are designed to lead to the 
goal of student intellectual development. 
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Student Achievement Goals 



Middle school programs are faced with criticism due to the perception that they 
have improved students' sense of emotional well-being but have yet to emphasize 
academic understanding and challenge (Beane, 1999; Clark & Clark, 2000; Lipsitz, 
Jackson, & Austin, 1997; Lipsitz, Mizell, Jackson, & Austin, 1997; Midgley & Edelin, 
1998; Williamson et ak, 1995). These criticisms have become more prevalent due to the 
recent movement towards accountability and high-stakes testing, as well as recent 
international reports of student achievement (Callahan, Tomlinson, Reis, & Kaplan, 
2000 ). 



It becomes critical that the middle school movement finds ways where the 
principles of affective development and the need for achievement results can co-exist 
(Midgley & Edelin, 1998). However, in negotiating this balance it is important that 
middle schools do not abandon the gains made in creating healthy social and emotional 
environments. Schools with high levels of academic rigor and high levels of social 
support have been found to achieve greater reading and math gains than schools that are 
focused only on one or the other dimension (Lee, Smith, Perry, & Smylie, 1999). 

Middle School Curriculum, Instruction, and Assessment 

Quality curriculum in the middle school articulates a clear set of goals for 
learning that reflect both deep, conceptual understanding of the subject area and mastery 
of skills needed for increasingly expert performance (Goldsmith & Kantrov, 2000). A 
rigorous curriculum offers students a coherent view of the subject area by providing 
connections that help students see and appreciate the recurring themes, ideas, and 
methodologies of the discipline instead of only isolated pieces (Goldsmith & Kantrov, 
2000). It provides opportunities for connections between classroom study and real-world 
applications, helping students to recognize the practical utility of their developing 
knowledge (Goldsmith & Kantrov, 2000). A rigorous curriculum requires products that 
are useful and applicable to the real world that arise from a variety of assessment 
techniques including performance tasks, projects, and portfolios (Beane, 1999; Brandt, 
1998; Erickson, 1998; Jackson & Davis, 2000; Maker & Neilson, 1995; Manning, 2000; 
National Middle School Association, 1995; Stix, 2000; Tomlinson, 2001; Wiggins & 
McTighe, 1998). 

Research suggests that classroom practices are characterized by one general 
curriculum with teachers relying on traditional teacher-directed, whole class instruction 
(George, 2001; Moon, Tomlinson, & Callahan, 1995). Presentation, question- and- answer 
opportunities, practice drills and re-teaching compose the most common instructional 
sequence in middle school classrooms (George, 2001; Moon et ak, 1995). Studies of 
schools across the nation find very little differentiation of instruction or flexible grouping 
taking place, despite the predominant use of heterogeneous classes (Moon, et ak, 1995; 
Plucker & Mclntire, 1996; Westberg, Archambault, Dobyns, & Salvin, 1993). These 
findings are in direct contrast with school organizational structures (e.g., interdisciplinary 
teams) that have been deliberately implemented in the middle school to support 
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collaboration among school faculty, for focusing on individual students' differences, and 
for the sharing and pooling of expertise (Moon et al., 1995). 

Academic Diversity in the Middle School 

Despite recommendations from national organizations and scholars that teachers 
work to accommodate student academic diversity within their classrooms through 
curriculum and instructional modifications (Jackson, & Davis, 2000; Manning, 2000; 
National Middle School Association, 1995), they do not appear to be using strategies that 
could benefit diverse learners on a regular basis in the classroom (Moon et al., 1995). 

This disregard of academic diversity affects students on both ends of the ability spectrum. 
While students with learning difficulties and other differently-abled students require 
modifications of curriculum and instruction to achieve success, advanced learners also 
require curricular modifications to reach their potential. Middle schools have been 
justifiably criticized for not providing services for the gifted (Tomlinson, 1994). 

In a study of high achieving middle schools, Peterson (2001) found frequent use 
of tracking, with all schools tracking in math and many in language arts. George (2001), 
in a recent study of Florida middle schools, found that the vast majority of middle schools 
provided advanced classes in at least math and language arts, if not also social studies and 
science, for gifted and high-ability students. The use of special classes is also supported 
by findings that middle school teachers and principals continue to believe that special 
classes are appropriate for remedial, special education, and advanced learners (Moon et 
al., 1995). However, the use of tracked classes is counter to one of the key principles of 
the middle school movement, heterogeneously grouped classes. 

Student Grouping in Middle Schools 

Heterogeneous grouping of students is one of the hallmarks of the middle school 
movement as a consequence of the rejection of tracking students by ability (Jackson & 
Davis, 2000; National Middle School Association, 1995). Advocates for eliminating 
tracking are concerned about the effect of lowered expectations on homogenously 
grouped struggling students and the disruption caused by grouping gifted students 
together for portions of the day (Sapon-Shevin, 1996), despite evidence that gifted 
students benefit from being grouped together (Kulik & Kulik, 1997; Lando & Schneider, 
1997; Rogers, 1998). 

Although structural changes have occurred within middle schools, such as the use 
of heterogeneous home groups within the school, it seems that little has changed in the 
ways students are taught. Changes in structure without changes in curricula have been 
implicated as part of the reasons that middle schools have not accomplished their 
achievement goals (Beane, 2001; Dickenson, 2001; Midgley & Edelin, 1998). 
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Key Questions Related to Academic Diversity in the Middle School 

As indicated earlier, this study is part of a larger study on addressing academic 
diversity as well as an update to a national study reported in 1995 on educators' beliefs 
and practices in addressing academic diversity in the middle school by The National 
Research Center on the Gifted and Talented (NRC/GT) at the University of Virginia. 

Key questions for the current study include: 

Teacher Questions 

• To what degree do middle school classrooms appear to engage in 
developmentally appropriate structures and practices likely to address the 
wide range of academic readiness, interests, and learning profiles 
inevitable in middle level populations? 

• What is the nature of the curriculum and instruction at the middle level 
and to what degree does it seem appropriately responsive to academic 
diversity? 

• How do middle school teachers enact the concept of differentiating or 
modifying curriculum and instruction based on learner readiness, interest, 
and learning profile? 

Student Questions 

• Are students' response patterns of their perceptions about their classrooms 
consistent with what is reported by teachers? 

Study Design 

Sample 

States 



Middle schools (grades 6-8) were invited to participate from the Collaborative 
School District Database of the NRC/GT based on the state testing programs in place at 
the time the study was planned. Schools that participated in the study represented three 
states with two states located on the East Coast and one in the Southwest. Information 
reported by each state's chief school officer (state superintendent) in the annual Council 
of Chief State School Officers (CCSSO) state assessment program survey (CCSSO, 

2000) was used to create the overviews of these states' testing programs which follow. 
While the original intent of the study was to classify each state according to the type of 
accountability tied to student outcomes, it became apparent early on in the study that 
regardless of the type of accountability reported by the CCSSO, teachers in all states 
considered the assessment programs in their states to be high-stakes. Therefore, we could 
not clearly control for differences in the testing environments across the three states. 




Schools 



Nine middle schools participated in the project representing four school districts 
in the three states described above. Schools were located in two small urban school 
districts, a large suburban school district, and a large urban school district. 

Each school was designated as a treatment site: differentiation and assessment, 
differentiated authentic assessment only, or comparison. Within each school, one 
interdisciplinary team of teachers at each grade level participated. Students who were 
assigned to the participating team served as the student sample. State One contained 
three schools, each representing a treatment (differentiation, assessment, and 
comparison); State Two contained four schools representing each treatment, with the 
assessment treatment having two schools; and State Three contained two schools, with 
only the differentiation and comparison treatments represented. 

Instrumentation 

Middle School Teacher Questionnaire 

The middle school teacher questionnaire used in this study was a modification of 
a survey used previously in a nationwide sample of middle school teachers (Moon, et ah, 
1995). The questionnaire contained 13 pages of questions that solicited information on 
(a) the background of the teacher, (b) the teacher's beliefs about classroom issues, and (c) 
the teacher's curriculum, instructional, and assessment practices. 

Middle School Student Content Questionnaires 

These questionnaires were developed to assess students' perceptions in each of 
their classrooms in each subject areas (Language Arts, Math, Science, and Social 
Studies). All questionnaires contained the same items with the only difference being the 
specific content area being inquired about. Several questions on these questionnaires 
mimicked questions on the teacher questionnaire. This was done to obtain the students' 
perceptions on the same issues that we had presented to the teachers. 

Attrition 

The study was designed to follow the same set of teachers in each school over a 3- 
year span across two treatment groups, differentiated instruction or differentiated 
authentic assessment, and a comparison group. However, the study experienced very 
high attrition rates among teachers. Due to high mobility of teachers and local 
redistricting efforts, some teachers were replaced each year of the study. In other cases, 
teachers self-transferred or were transferred out of the school, transferred or were 
transferred to another team within the school that was not participating in the study, or 
simply stopped participating. At the conclusion of the study there were a total of 76 
teachers. 
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Student Demographics 



The actual implementation of the project in the schools occurred over a 3-year 
period. The study was designed to follow the same set of teachers in each school with 
three different cohorts of students across a 3 -year span. Cohort one was those students 
who participated in the study for 2 years (n=724). Within this cohort were two different 
grade levels, students beginning in grade 6 (n=352) and students beginning in grade 7 
(n=312). Cohort two was those students who participated in the study for 3 years (n=314). 
This cohort was composed only of those students who entered the study as sixth graders 
and exited as eighth graders. Cohort three was those students who participated in the 
study for 1 year. This cohort was composed of 923 sixth graders and 74 eighth graders. 
One school requested that eighth grade students be tested in the first year of the project. 

Data Collection 

Baseline data were collected in the fall of the second year of the study for students 
in grades 6 and 7; in Years 3, 4, and 5 students were re-assessed in the spring as they 
exited each participating middle school. 

Data Analysis 

Teacher questionnaire. All teachers participating in the study were asked to 
complete the Middle School Teacher Questionnaire (MSTQ) prior to the project 
beginning or during their first year if they did not start the project in the first year. 
Teachers were also asked to complete the MSTQ at the end of the project. 

Many teachers who completed the MSTQ prior to the larger project's 
implementation did not complete the MSTQ at the conclusion of the project due to 
attrition. Hence, pre-post project comparisons were not possible. However, using a two 
factor between subjects design (state and treatment), a series of analyses of variance 
procedures (ANOVAs), controlling for Type I error, were conducted to determine if 
statistically significant differences existed on the teachers' responses to the pre-project 
survey questions between states or treatments. No statistically significant differences 
were found. Because there were no statistical differences in responses, teachers' 
responses across states and treatments were aggregated and only descriptive statistics 
were computed. To avoid any misinterpretations of the data because of teacher attrition 
rates only the pre-project survey are presented. 

Student questionnaire. Using a two-factor between subjects design (state and 
treatment), a series of ANOVAs, controlling for Type I error, were conducted to 
determine if statistically significant differences existed. 

Because there were no differences in student responses within cohorts or within 
schools for any content area, all cohorts and schools were collapsed for each content area. 
For each content area survey, descriptive analyses were performed item-by-item. (Upon 
request individual cohort or school descriptive statistics can be obtained.) 
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Results 



Student responses to many of the questions were similar regardless of subject area 
considered. Teacher's responses sometimes confirmed and sometimes differed from the 
pattern of responses of the students. 

The majority of students in all classrooms reported listening to the teacher lecture, 
working alone on drills, and working on the same assignment as other students daily. In 
addition, students reported working alone on individual contracts and participating in 
class discussions where the teacher seemed interested in new ways of solving problems at 
least weekly. The majority of students also reported never having individual conferences 
with the teachers. 

Teachers' responses also reflected the student responses about typical instructional 
practice in all subject area classrooms. The majority of teachers reported using learning 
contracts less than once per year and using independent studies only twice a year or less. 
Teachers also indicated using lecture, whole group and small heterogeneous group 
working on the same assignment at least weekly, while individuals and small 
heterogeneous groups working on different assignments and small homogeneous group 
working on the same assignment were used less often. 

Students from all areas also reported teachers used example activities and 
performance on classroom activities to assess what they already knew prior to instruction 
at least weekly. However, the majority of students reported they were never allowed to 
skip an assignment because they already knew the material, never received different 
materials or assignments from other students, and were never allowed choices in 
selecting a project or class work. Teachers agreed with students on the type of pre- 
assessment strategies used and the frequency of their use. Teachers also reported they 
never or rarely used student choices with advanced learners or struggling learners. 
However, teachers indicated they used varying materials based on students reading level, 
and adjusted the time, length or depth of the assignment at least monthly for both groups 
of learners. 

Students in all areas reported they were often or always able to keep up with the 
instruction and assignments. The majority of students reported the teacher often or 
always taught material so that the students could pass the end of chapter tests, and nearly 
half of the students reported lessons were often or always based directly on the textbook. 
Additionally, students indicated rarely or never were their interests considered in what 
they learned or activities they did, nor were they allowed choices about what they learn. 
Teachers agreed that the textbook was frequently used, however, in contrast to student 
responses, teachers believed students' interests were addressed. The majority of teachers 
indicated textbooks and student questions and interests were important or extremely 
important in determining the content they taught. 

Most students agreed or strongly agreed they worked well independently, worked 
best for a grade honor or privilege, showed their best learning when they did a project or 
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took multiple-choice tests. In addition, students agreed or strongly agreed they preferred 
learning activities that would aid them in remembering information for later testing times, 
as well as activities where new, creative or very different ideas are encouraged, listened 
to, and discussed. Students in all content areas agreed or strongly agreed they were 
learning things that were important to them, they were working to their potential, and 
they preferred to work with students who shared similar interests. Furthermore, students 
agreed or strongly agreed they liked the opportunity to revise their work before the final 
grade, there was more to a subject than getting the right answer, but the teacher tended to 
think that there was a best way to answer a question. Teacher responses suggested there 
was not a match between the student's preferred learning style and the teaching style. In 
contrast to student preferences, teachers indicated rarely or never using flexible grouping 
based on student interest with advanced learners, and only sometimes with struggling 
learners. Teachers reported using projects to assess student achievement twice a month 
or less. Teachers also reported inconsistent use of multiple choice items, with 50% 
indicating using these items sometimes to never, while the other 50% used multiple 
choice items often or always. 

The majority of students reported the teacher was often or always the decision 
maker when it came to grades. However, a large percentage of students indicated the 
teacher only sometimes clearly explained the grading criteria. Students from all areas 
indicated tests, assignments, projects, hard work, and individual improvement were all 
very important in determining their grade. In addition, students reported how they did 
compared to other students was not important. Teacher responses on grading issues 
tended to agree with the student responses. The majority of teachers reported the teacher 
was often or always the sole decision maker when it came to grades. Teachers also 
indicated tests, projects, homework, class participation, and individual improvement were 
all important or extremely important in determining grades. However, teachers reported 
effort was extremely important, while how the student did compared to the rest of the 
class was only somewhat important. 



Conclusions 

Although this study provides only a glimpse into teachers' classrooms, several 
conclusions seem warranted. 

• There appears to be room for improvement in developing teachers' skills 
in addressing academic diversity in middle school classrooms. 

• Teachers' make little use of strategies (instructional or structural) that 
would enable the academic diversity of students to be better addressed. 

The degree that teachers' practices are narrow in scope at the pre-assessment, 
instructional and summative phases of instruction have a strong hold and are persuasive 
in the school environment which may in fact be one of the biggest obstacles in moving 
teachers toward addressing academic diversity. Results from this study suggest that 
teachers practice traditional schooling that should be questioned and re-examined prior to 
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them being able to consider an educational innovation such as differentiation of 
instruction and/or the use of differentiated authentic assessments for addressing the 
varying levels of student academic diversity in the middle school classroom. 
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Introduction 



Middle school teachers' reported classroom practices, middle school students' 
perceptions of classroom practice, and the alignment of reported practices and 
perceptions with the middle school movement's orientation towards student achievement 
form the foci of this study. As part of a larger study looking at two different 
interventions for addressing the academic diversity of middle school learners (Callahan, 
Tomlinson, Moon, Brighton, & Hertberg, in preparation), teachers in participating 
schools were asked to complete a middle school practices survey. Students completed a 
parallel survey on their perceptions of their classrooms. In addition to reporting teacher 
and student responses to the surveys, comparisons between teacher reported practices and 
student perceptions as well as comparisons with the 1995 national study of middle school 
teacher practices (Moon, Tomlinson, & Callahan, 1995) are provided in this monograph. 
Examination of teacher practices and student perceptions in addressing academic 
diversity in middle school classrooms evolved from examining the literature on: (a) 
characteristics of middle school students, (b) student achievement goals in the middle 
school, (c) middle school curriculum, instruction and assessment practices, (d) 
accommodating academic diversity in the middle school classroom, and (e) student 
grouping. 

bindings replicate what was previously found in the 1995 NRC/GT study as well 
as provide unique findings relative to the particular interventions implemented as part of 
the larger NRC/GT study. Consistent with the 1995 study findings, teachers report that 
learning contracts, tiered assignments, advanced organizers, computer programs focusing 
on basic skills or advanced understanding, curriculum compacting, learning centers, 
flexible grouping, or interest centers are rarely used in their middle school classrooms. In 
contrast to the 1995 study findings, state curriculum standards, local curriculum guides, 
and key concepts and principles of core disciplines are considered the three most 
important factors in determining instructional content taught by teachers. 

bindings unique to the study indicate the majority of teachers report using 
example activities and observations to modify the content of activities, types of products 
required of students, and student grouping arrangements; yet a large portion of teachers 
also indicate never tailoring an assignment for students or varying materials based on 
student readiness levels. Instead, lecture, direct instruction to the whole class using the 
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State standards and local curriculum guides, is the predominant reported modality of 
teaching. Students indicated, consistent with teachers' responses, that the instructional 
content of their classes was textbook driven and focused on student success for more 
formal assessments (e.g., end-of-unit tests, standardized tests). Students also indicated 
whole group instruction supported by note taking and all students working on the same 
assignment as the predominant format of their classrooms. 



Review of the Literature 

The distinct social, psychological, and academic needs of early adolescents have 
long been recognized. Junior high schools, typically including grades 7 through 9, were 
first established because the upper grades of primary schools were seen as failing to meet 
the needs of early adolescents (Clark & Clark, 1993). More academic challenge to 
support intellectual growth as well as ways to address the developmental needs of young 
adolescents were called for by reform- minded educators (Clark & Clark, 1993). 

However, the growth of junior high schools generated several waves of criticism 
including: fragmented curriculum taught in departmentalized classes; heavy emphasis on 
teacher lectures and students' passive observation; predominant reliance on textbooks; 
tracking students by ability; and inadequate teacher training, particularly in the area of 
early adolescents' psychosocial, emotional, and cognitive development (Clark & Clark, 
1993). While the middle school movement has sought to address these issues, the middle 
school as it has evolved has not escaped criticism. 

One of the most pivotal concerns voiced in the literature on the middle school is 
the lack of academic rigor (Beane, 1999; Gallagher, Harradine, & Coleman, 1997; 
Tucker, & Codding, 1998; Williamson, Johnston, & Kanthak, 1995). Tucker and 
Codding (1998) recently called middle schools "the wasteland of our primary and 
secondary landscape" (p. 153). Specific criticisms concerning the lack of academic 
progress of middle school students include: 

• a lack of curricular focus on core academic courses and analytical skills 
leading students to focus away from school and even become alienated 
from it; 

• a lack of preparation for either high school or meaningful employment; 

• a dramatic increase in inflexible ability grouping as children enter middle 
school, restricting at-risk students' access to challenging curricula and 
contributing to subsequent low achievement (Ames, 1998; Argetsinger, 
1999; Carnegie Council on Adolescent Development, 1989; McEwin, 
Dickinson, & Jenkins, 1996). 

Some critics have suggested that overemphasizing social, psychological, physical, 
and emotional needs of middle school students has contributed to schools that do not 
academically challenge students. In apparent response to these criticisms the most 
significant change in the 2000 edition of Turning Points is the designation of student 
success and achievement as the primary goal, and as a more important goal than any 
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Other recommendation made. Jackson and Davis (2000) explicitly stated, "Let us be 
clear. The main purpose of middle grades education is to promote young adolescents' 
intellectual development" (p. 10). All other recommendations in Turning Points 2000, 
including those related to social and emotional development, are designed to lead to the 
goal of student intellectual development. 

Characteristics of Middle School Learners 

Understandings of the developmental characteristics of early adolescents drive 
beliefs about what is educationally appropriate for these students. The National Middle 
School Association (NMSA) (1995) has compiled a synthesis of these characteristics, 
which are divided into five areas: intellectual, moral, physical, emotional/psychological, 
and social development. 

NMSA (1995) describes young adolescents' intellectual development as follows. 
Young adolescents . . . 

• display a wide range of individual intellectual development, 

• are in a transition period from concrete thinking to abstract thinking, 

• are intensely curious and have a wide range of intellectual pursuits, few of 
which are sustained, 

• prefer active over passive learning experiences, 

• prefer interaction with peers during learning activities, 

• respond positively to opportunities to participate in real life situations, 

• are often preoccupied with self, 

• have a strong need for approval and may be easily discouraged, 

• develop an increasingly better understanding of personal abilities, 

• are inquisitive about adults, often challenging their authority, and always 
observing them, 

• may show disinterest in conventional academic subjects, but are 
intellectually curious about the world, and 

• are developing a capacity to understand higher levels of humor, (pp. 35- 
36) 

Some of these characteristics are supported in reported studies of educators' 
beliefs about middle school learners and others are not. For example, teachers see middle 
school students as concrete thinkers, extrinsically motivated, easily discouraged, not able 
to think at high levels, weak in basic skills, and not very independent in their learning 
(Moon, Tomlinson, & Callahan, 1995); these characteristics are not supported by 
research. 



Student Achievement Goals 

Middle school programs are faced with criticism due to the perception that they 
have improved students' sense of emotional well-being but have yet to emphasize 
academic understanding and challenge (Beane, 1999; Clark & Clark, 2000; Lipsitz, 
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Jackson, & Austin, 1997; Lipsitz, Mizell, Jackson, & Austin, 1997; Midgley & Edelin, 
1998; Williamson et ak, 1995). The positive steps made toward making school a safer, 
happier, and healthier environment have not translated into academic gains. According to 
Lipsitz, Jackson et al. (1997): 

We are frankly concerned that, despite their heavy investment in middle-grades 
reform, many schools have not progressed beyond the stage of changing climate. 
We have not seen the widespread dramatic improvement in academic outcomes 
we had hoped for. A variety of state, national, and international studies in 
reading, mathematics, and science confirm that the middle grades are 
characterized by academic stagnation and actual loss among schools serving 
children in poverty, (p. 535) 

These criticisms have become more prevalent due to the recent movement towards 
accountability and high- stakes testing, as well as recent international reports of student 
achievement (Callahan, Tomlinson, Reis, & Kaplan, 2000). 

The middle school movement is faced with the challenge of balancing the 
principles of affective development and the need for achievement results (Midgley & 
Edelin, 1998). However, in negotiating this balance it is important that middle schools 
do not abandon the gains made in creating healthy social and emotional environments. 
Schools with high levels of academic rigor and high levels of social support have been 
found to achieve greater reading and math gains than schools that are focused only on 
one or the other dimension (Lee, Smith, Perry, & Smylie, 1999). Eurther, increase in 
school implementation of the initiatives outlined in the 1989 Turning Points produced 
increased math and language arts scores for eighth grade students in a study comparing 
middle schools with varying levels of implementation of the strategies (Eelner et ak, 
1997). These findings suggest that both academic rigor and social support are needed to 
achieve the goals supported by the middle school movement. 

Middle School Curriculum, Instruction, and Assessment 

Quality curriculum in the middle school articulates a clear set of goals for 
learning that reflect both deep, conceptual understanding of the subject area and mastery 
of skills needed for increasingly expert performance (Goldsmith & Kantrov, 2000). A 
rigorous curriculum offers students a coherent view of the subject area by providing 
connections that help students see and appreciate the recurring themes, ideas, and 
methodologies of the discipline instead of only isolated pieces (Goldsmith & Kantrov, 
2000). It provides opportunities for connections between classroom study and real-world 
applications, helping students to recognize the practical utility of their developing 
knowledge (Goldsmith & Kantrov, 2000). A rigorous curriculum requires products that 
are useful and applicable to the real world that arise from a variety of assessment 
techniques including performance tasks, projects, and portfolios (Beane, 1999; Brandt, 
1998; Erickson, 1998; Jackson & Davis, 2000; Maker & Neilson, 1995; Manning, 2000; 
National Middle School Association, 1995; Stix, 2000; Tomlinson, 2001; Wiggins & 
McTighe, 1998). 
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It is also important that curricula not underestimate the intellectual capabilities of 
early adolescents. However, curriculum of this caliber does not appear to be the basis of 
what has been implemented through textbooks in middle school classrooms. According 
to one district mathematics supervisor (Goldsmith & Kantrov, 2000): 

In reviewing curricula we found some books had hardly anything new from year 
to year. Those books presented the same activities, the same concepts, year after 
year. There was just no depth, (p. 34) 

Classroom practices also seem to be characterized by one general curriculum with 
teachers relying on traditional teacher-directed, whole class instruction (George, 2001; 
Moon et ah, 1995). Presentation, question- and- answer opportunities, practice drills and 
re-teaching compose the most common instructional sequence in middle school 
classrooms (George, 2001; Moon et ah, 1995). Studies of schools across the nation find 
very little differentiation of instruction or flexible grouping taking place, despite the 
predominant use of heterogeneous classes (Moon et ah, 1995; Plucker & Mclntire, 1996; 
Westberg, Archambault, Dobyns, & Salvin, 1993). These findings are in direct contrast 
with school organizational structures (e.g., interdisciplinary teams) that have been 
deliberately implemented in the middle school to support collaboration among school 
faculty, for focusing on individual students' differences, and for the sharing and pooling 
of expertise (Moon et ah, 1995). 

Academic Diversity in the Middle School 

Despite recommendations from national organizations and scholars that teachers 
work to accommodate student academic diversity within their classrooms through 
curriculum and instructional modifications (Jackson, & Davis, 2000; Manning, 2000; 
National Middle School Association, 1995), they do not appear to be using strategies that 
could benefit diverse learners on a regular basis in the classroom (Moon et ah, 1995). 

This disregard of academic diversity effects students on both ends of the ability spectrum. 
While students with learning difficulties and other differently-abled students require 
modifications of curriculum and instruction to achieve success, advanced learners also 
require curricular modifications to reach their potential. Middle schools have been 
justifiably criticized for not providing services for the gifted (Tomlinson, 1994). At the 
same time that one-size-fits-all teaching is occurring, the smallest numbers of classes are 
provided for advanced learners, with offered classes typically only being in the areas of 
math and language arts (VanTassel-Baska, 2000). 

In a study of high achieving middle schools, Peterson (2001) found frequent use 
of tracking, with all schools tracking in math and many in language arts. George (2001), 
in a recent study of Florida middle schools, found that the vast majority of middle schools 
provided advanced classes in at least math and language arts, if not also social studies and 
science, for gifted and high-ability students. The use of special classes is also supported 
by findings that middle school teachers and principals continue to believe that special 
classes are appropriate for remedial, special education and advanced learners (Moon et 
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al., 1995). However, the use of tracked classes is counter to one of the key principles of 
the middle school movement, heterogeneously-grouped classes. 

Student Grouping in Middle Schools 

Heterogeneous grouping of students is one of the hallmarks of the middle school 
movement as a consequence of the rejection of tracking students by ability (Jackson & 
Davis, 2000; National Middle School Association, 1995). Advocates for eliminating 
tracking are concerned about the effect of lowered expectations on homogenously 
grouped struggling students and the disruption caused by grouping gifted students 
together for portions of the day (Sapon-Shevin, 1996), despite evidence that gifted 
students benefit from being grouped together (Kulik & Kulik, 1997; Lando & Schneider, 
1997; Rogers, 1998). 

Heterogeneous grouping has several drawbacks for students with diverse learning 
needs. First, the elimination of ability groups in middle schools does not guarantee that 
the resulting heterogeneous classrooms are high-level and challenging (Midgley & 
Edelin, 1998). Even researchers who advocate heterogeneous grouping recognize the 
problems associated with this arrangement. Sapon-Shevin (1996) writes, "few educators 
would advocate equal treatment if by that we meant giving every child the same kind of 
educational experiences at the same pace, using the same materials, and so on. Neither 
can it be argued that all students will emerge the same (equality of outcomes) regardless 
of how well (or badly) they are treated" (p. 198). Yet this appears to be what is occurring 
in middle school classrooms. Students are working at the same pace using the same 
materials. 

Although structural changes have occurred within middle schools, such as the use 
of heterogeneous home groups within the school, it seems that little has changed in the 
ways students are taught. Changes in structure without changes in curricula have been 
implicated as part of the reasons that middle schools have not accomplished their 
achievement goals (Beane, 2001; Dickenson, 2001; Midgley & Edelin, 1998). 

Key Questions Related to Academic Diversity in the Middle School 

As indicated earlier, this study is part of a larger study on addressing academic 
diversity as well as an update to a national study reported in 1995 on educators' beliefs 
and practices in addressing academic diversity in the middle school by The National 
Research Center on the Gifted and Talented (NRC/GT) at the University of Virginia. 

Key questions for the current study include: 

Teacher Questions 

• To what degree do middle school classrooms appear to engage in 

developmentally appropriate structures and practices likely to address the 
wide range of academic readiness, interests, and learning profiles 
inevitable in middle level populations? 




7 



• What is the nature of the curriculum and instruction at the middle level 
and to what degree does it seem appropriately responsive to academic 
diversity? 

• How do middle level teachers enact the concept of differentiating or 
modifying curriculum and instruction based on learner readiness, interest, 
and learning profile? 

Student Question 

• Are students' response patterns of their perceptions about their classrooms 
consistent with what is reported by teachers? 

Study Design 

Sample 

States 



Middle schools (grades 6-8) were invited to participate from the Collaborative 
School District Database of the NRC/GT based on the state testing programs in place at 
the time the study was planned. Schools that participated in the study represented three 
states with two states located on the East Coast and one in the Southwest. Information 
reported by each state's chief school officer (state superintendent) in the annual Council 
of Chief State School Officers (CCSSO) state assessment program survey (CCSSO, 

2000) was used to create the overviews of these states' testing programs which follow. 
While the original intent of the study was to classify each state according to the type of 
accountability tied to student outcomes, it became apparent early on in the study, that 
regardless of the type of accountability reported by the CCSSO, teachers in all states 
considered the assessment programs in their states to be high-stakes. Therefore, we could 
not clearly control for differences in the testing environments across the three states. 

State One. This state's assessment program consisted of legislatively-mandated 
criterion-referenced exams in reading, writing, science, and social studies in eighth grade. 
Also in place was an end-of-course exam in Algebra I. State officials indicated that the 
primary purpose of the program was to provide an accurate measure of student 
achievement in these areas, with the results being used as a gauge for institutional 
accountability. 

State Two. This state's assessment program consisted of two state legislatively- 
mandated components related to the middle school years: (a) assessments of the state's 
content standards; and (b) a norm-referenced achievement test battery. The standards- 
based assessments were given to middle school students in eighth grade in English, 
mathematics, history, science, and technology. A norm-referenced assessment was 
administered in the fall to all sixth grade students. State officials indicated that the 




assessments were for instructional purposes, student accountability, and school 
accountability. 

State Three. In this state assessment program, eighth grade students were 
administered criterion-referenced performance assessments in reading, writing, language 
usage, math, science, and social studies. State officials indicated that the program was 
for instructional purposes and school accountability. In addition, high school graduation 
requirements included passing objective tests in reading, mathematics, and citizenship 
starting in seventh grade. 

Schools 

Nine middle schools participated in the project representing four school districts 
in the three states described above. Schools were located in two small urban school 
districts, a large suburban school district, and a large urban school district. 

Each school was designated as a treatment site: differentiation and assessment, 
differentiated authentic assessment only, or comparison. Within each school, one 
interdisciplinary team of teachers at each grade level participated. Students who were 
assigned to the participating team served as the student sample. State One contained 
three schools, each representing a treatment (differentiation, assessment, and 
comparison); State Two contained four schools representing each treatment, with the 
assessment treatment having two schools; and State Three contained two schools, with 
only the differentiation and comparison treatments represented. 

Instrumentation 

Middle School Teacher Questionnaire 

The middle school teacher questionnaire used in this study was a modification of 
a survey used previously in a nationwide sample of middle school teachers (Moon et ah, 
1995). The questionnaire contained 13 pages of questions that solicited information on 
(a) the background of the teacher, (b) the teacher's beliefs about classroom issues, and (c) 
the teacher's curriculum, instructional, and assessment practices. A variety of question 
formats were used to gather the information. Some questions used a 4-point Likert scale 
(e.g., strongly disagree to strongly agree), other questions used a 6-point graduated 
frequency scale (e.g., never use to use daily). For each question related to decision- 
making practices, two formats were used: (a) a 4-point Likert scale ranging from "Not 
Important" to "Very Important," and (b) a ranking format based on ranking the eight most 
influential factors for each decision. Because teachers tend to rate most factors as 
important or very important, at some point in the decision-making process factors 
become weighted by their relative importance. Therefore, teachers were also asked to 
rank the relative importance of each factor. This ranking format was used to generate 
variation among individual factors. Detailed descriptions of the factors for the sections 
indicated are provided below. 
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Teacher background. This section of the questionnaire contained questions 
related to the teacher's sex, racial/ethnic status, highest academic degree earned, type of 
teacher certification/endorsement held, discipline(s) and the grade level(s) the teacher 
was primarily responsible for teaching, and full-time teaching experience at the 
elementary, middle, and secondary levels. 

Teacher beliefs. Questions in this section of the questionnaire included teacher 
beliefs about reasons for possible lack of learning options provided in classrooms to 
address academically diverse learners. 

Teacher's curriculum, instruction, and assessment practices. In this section of the 
survey, questions were asked about the use of (a) particular instructional strategies used 
to address students' varied readiness levels and learning needs, (b) influence on 
instruction of particular types of student assessment, and (c) decision-making processes 
relative to curriculum, instruction, and assessment practices. 

Middle School Student Content Questionnaires 

These questionnaires were developed to assess students' perceptions in each of 
their classrooms in each subject areas (Language Arts, Math, Science, and Social 
Studies). All questionnaires contained the same items with the only difference being the 
specific content area being inquired about. Several questions on these questionnaires 
mimicked questions on the teacher questionnaire. This was done to obtain students' 
perceptions on the same issues we had presented to the teachers. The initial 
questionnaires were piloted in January, 1996 with a sample of Virginia middle school 
students. Students' feedback on the questionnaires resulted in several revisions to clarify 
particular items. 



Teacher Attrition 

The study was designed to follow the same set of teachers in each school over a 3- 
year span across two treatment groups, differentiated instruction or differentiated 
authentic assessment, and a comparison group. However, the study experienced very 
high attrition rates among teachers. Due to high mobility of teachers and local 
redistricting efforts, some teachers were replaced each year of the study. In other cases, 
teachers self-transferred or were transferred out of the school, transferred or were 
transferred to another team within the school that was not participating in the study, or 
simply stopped participating. Table 1 presents the teacher attrition rate for each school. 
At the conclusion of the study there were a total of 76 teachers. 
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Table 1 



Teacher Attrition Rates for Each School Participating in the Study 





School 


Pre N 


Post N 


Attrition Rate 


(U 

c 

O 


Haden (C) 


22 


5 


73% 


Howard (D) 


28 


7 


75% 


o 

-I— < 

a 


Rockford (P) 


22 


15 


32% 


GO 


Marshall (P) 


27 


10 


63% 


O 


Cleveland (C) 


28 


8 


71% 


H 

(U 


Franklin (D) 


27 


15 


56% 


-I— < 
00 


Langley (P) 


18 


6 


67% 




Parkway (C) 


20 


8 


40% 


00 f-H 


Greene (D) 


19 


2 


90% 



C = Comparison 

D = Differentiated Instruction 

P = Differentiated Authentic Assessment 



Student Attrition 

The study was designed to follow the same set of students in each school over a 3- 
year span across two treatment groups, differentiated instruction, differentiated authentic 
assessment, or a comparison group. However, there was some student attrition over the 
course of the study due to several factors: student mobility, transfers to non-participating 
teams, and redistricting of schools. Table 2 presents the attrition rate for each student 
cohort by each school. 



Teacher Demographics 

Teacher demographic data are presented in Tables 3-5 for each school 
participating in the project. In many of the schools, teachers did not respond to all 
questions; therefore, percentages oftentimes do not total 100%. 









Student Attrition Rates for Each School 
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Cohort 3 


Attrition 

Rate 


28% 

4% 

41% 

80% 


17% 

11% 

15% 


0% 

5% 
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27 
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Cohort 2 


Attrition 

Rate 


60% 

38% 

71% 

72% 


51% 

65% 

41% 


41% 

31% 


Post 
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t-H od ’-H 


39 

46 

51 


23 

47 
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State One 

This state had four schools participating in the project for a total of 99 teachers 
when the project began. Haden served as a comparison school with 22 teachers 
participating. Howard served as the differentiation school, with 28 teachers participating. 
Rockford served as one assessment school, with 22 teachers participating. Marshall 
served as a second assessment school, with 27 teachers participating. 

Based on the information given by teachers in the pre-project survey, Caucasian 
females comprised the majority of each school's teaching cadre, with all grade levels and 
core content areas represented. The majority of teachers in each school reported at least 2 
years teaching experience at the middle school with most indicating that their experience 
was with the school participating in the project. However, less than half of the teachers 
in each school reported holding a 6-8 teaching certificate. 

When asked about their degree of satisfaction with teaching, teachers, in general, 
reported a medium high to generally high level of satisfaction. Overall, teachers reported 
that their students were from all socio-economic levels. However, teachers from the 
comparison school and one assessment school reported that their students represented 
low to middle socio-economic levels. The other assessment school and the 
differentiation school indicated that their students, in general, were from middle to high 
socio-economic levels. 

State Two 

This state had three schools participating in the project for a total of 73 teachers 
when the project began (27 in the differentiation school, 18 in the assessment school, 28 
in the comparison school). Based on the information given by teachers in the pre-project 
survey, Caucasian females comprised the majority of each school's teaching force, with 
all grade levels and core content areas represented. The majority of teachers in each 
school reported at least 2 years teaching experience at the middle school level. However, 
less than 25% of the teachers reported holding a 6-8 teaching certificate. 

When asked about their degree of satisfaction with teaching, teachers, in general, 
reported a medium high to generally high level of satisfaction. Teachers also reported 
that their students generally came from low to middle socio-economic environments. 

Cleveland served as a comparison school, with 28 teachers participating. Franklin 
served as a differentiation school, with 27 teachers participating. Langley served as an 
assessment school, with 18 teachers participating. 

State Three 

This state had two schools participating in the project for a total of 39 teachers 
when the project began. Parkway served as a comparison school, with 20 teachers 
participating. Greene served as a differentiation school, with 19 teachers participating. 
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Based on the information given by teachers in the pre-project survey, females and 
males were about equally represented in the comparison school with most teachers being 
male in the differentiation school. Regardless of gender, all teachers reported being 
Caucasian. Each grade level and content area were represented in the project by both 
schools, with the majority of teachers reporting at least 2 years teaching experience at the 
middle school level. Less than 20% of the teachers in both schools reported holding a 6- 
8 teaching certificate. 

When asked about their degree of satisfaction with teaching, teachers, in general, 
reported a medium to high level of satisfaction. No teachers reported a low level of 
satisfaction with teaching. When asked about the socio-economic level of their students, 
the differentiation school reported their students coming from middle to high socio- 
economic environments, while the comparison school teachers reported their students 
coming from low to middle socio-economic environments. 

Student Demographics 

The actual implementation of the project in the schools occurred over a 3-year 
period. Demographic data are presented within each student cohort group, aggregated by 
treatment condition for the variables of student gender, race/ethnicity, and gifted 
identification. The study was designed to follow the same set of teachers in each school 
with three different cohorts of students across a 3 -year span. Cohort one was those 
students who participated in the study for 2 years (n=724). Within this cohort were two 
different grade levels, students beginning in grade 6 (n=352) and students beginning in 
grade 7 (n=312). Cohort two was those students who participated in the study for 3 years 
(n=314). This cohort was composed only of those students who entered the study as 
sixth graders and exited as eighth graders. Cohort three was those students who 
participated in the study for 1 year. This cohort was composed of 923 sixth graders and 
74 eighth graders. One school requested that eighth grade students be tested in the first 
year of the project. 

Student Cohort 1 

Cohort 1 had two sets of students. In both subsets, students in this cohort 
participated in the project for 2 complete school years. Subset A consisted of students 
who began the project as sixth graders and exited as seventh graders. These were 
students who were sixth graders in the fall of the second year of the project. Subset B 
was comprised of students who began the project as seventh graders and exited as eighth 
graders. These were students who were seventh graders in the fall of the second year of 
the project. 

Subset A. For each school, demographic information collected is presented in 
Tables 6-8. 
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Table 6 

Subset A: Student Gender by Treatment Within State 





Females 


Males 


State One 






Comparison Group 


20 (77) 


6(23) 


Differentiation Group 


15 (27) 


40 (73) 


Assessment Group 


55 (59) 


40 (41) 


State Two 






Comparison Group 


27 (64) 


15 (36) 


Differentiation Group 


12 (43) 


16 (57) 


Assessment Group 


31 (51) 


29 (48) 


State Three 






Comparison Group 


13 (81) 


3(19) 


Differentiation Group 


25 (46) 


30 (54) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 7 

Subset A: Student Racial/Ethnic Group by Treatment Within State 





Caucasian 


African 

American 


Asian/ 

Pacific 

Islander 


Hispanic 


Native 

American 


State One 












Comparison Group 


21 (81) 


5(19) 








Differentiation Group 


53 (96) 


2(4) 








Assessment Group 


64 (69) 


23 (25) 




4(4) 


1(1) 


State Two 












Comparison Group 


21 (50) 


14 (33) 


7(17) 






Differentiation Group 


17(61) 


1(4) 


10 (36) 






Assessment Group 


17 (28) 


41 (68) 




2(2) 


1(1) 


State Three 

Comparison Group 
Differentiation Group 


14 (88) 
34 (62) 


2(13) 
18 (33) 




3(6) 





Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 8 



Subset A: Student Gifted Status by Treatment within State 





Identified Gifted 


Non-Identified 


State One 






Comparison Group 


26 (100) 




Differentiation Group 


18 (33) 


37 (67) 


Assessment Group 


21 (23) 


71 (77) 


State Two 






Comparison Group 


2(5) 


40 (95) 


Differentiation Group 


8 (29) 


20 (71) 


Assessment Group 


9(15) 


52 (85) 


State Three 






Comparison Group 


16 (100) 




Differentiation Group 


55 (100) 





Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 



The comparison group within State One was 77% female, 81% Caucasian and 
19% African American. All of the students were identified as gifted and talented. For 
the differentiation group in State One, 27% were female, 96% Caucasian and 4% African 
American. Thirty-three percent of the students had been identified as gifted and talented. 
Within the assessment group, 59% were female, 69% Caucasian, 25% African American, 
4% Hispanic, and 1% Native American. Twenty-three percent of the students were 
identified as gifted and talented. Overall demographics for State One were 52% female, 
79% Caucasian, 17% African American, 2% Hispanic, with less than 1% Native 
American. Thirty-eight percent of the students were identified as gifted and talented. 

For the comparison group within State Two, 64% were female, 50% Caucasian, 
33% African American, and 17% Asian/Pacific Islander. Only 5% of the students in the 
comparison group were identified as gifted and talented. Within the differentiation 
group, 43% were female, 61% Caucasian, 36% Asian/Pacific Islander, and 4% African 
American. Twenty-nine percent of the students were identified as gifted and talented. 

For the assessment group, 51% were female, 68% African American, 28% Caucasian, 2% 
Hispanic and 1% Native American. Fifteen percent of the students were identified as 
gifted and talented. Overall demographics for State Two were 53% female, 43% African 
American, 42% Caucasian, 13% Asian/Pacific Islander, and 1% Hispanic and Native 
American. Fifteen percent of the students were identified as gifted and talented. 
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For State Three, the comparison group was comprised of 81% female, 88% 
Caucasian and 13% African American. All of the students were identified as gifted and 
talented. Within the differentiation group, 46% were female, 62% Caucasian, 33% 
African American, and 6% Hispanic. All of the students in the differentiation group were 
also identified as gifted and talented. Overall demographics for State Three were 54% 
female, 67% Caucasian, 28% African American, and 4% Hispanic, with all students 
identified as gifted and talented. 

Subset B. For each school, demographic information collected is presented in 
Tables 9-11. Subset B consisted of those students who began the project as seventh 
graders and exited as eighth graders. These were students who were seventh graders in 
the fall of the first year of the project. 



Table 9 



Breakdown by Student Gender by Treatment Within State 





Females 


Males 


State One 






Comparison Group 


14 (67) 


7 (33) 


Differentiation Group 


46 (62) 


28 (38) 


Assessment Group 


49 (54) 


35 (39) 


State Two 






Comparison Group 


35 (70) 


15 (30) 


Differentiation Group 


21 (46) 


25 (54) 


Assessment Group 


35 (61) 


22 (39) 


State Three 






Comparison Group 


15 (58) 


1 1 (42) 


Differentiation Group 


25 (53) 


22 (47) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 10 

Breakdown by Student Racial/Ethnicity by Treatment Within School 





Caucasian 


African 

American 


Asian/ 

Pacific 

Islander 


Hispanic 


Native 

American 


State One 












Comparison Group 


9(43) 


12 (57) 








Differentiation Group 


65 (88) 


6(8) 


3(4) 






Assessment Group 


64 (71) 


20 (22) 


4(4) 




1(<1) 


State Two 












Comparison Group 


48 (96) 


2(4) 








Differentiation Group 


25 (54) 


5(11) 




16 (35) 




Assessment Group 


18 (32) 


31 (54) 


4(7) 


3(5) 


1(2) 


State Three 

Comparison Group 
Differentiation Group 


21 (81) 
20 (43) 


4(15) 
26 (55) 


1(1) 


1(1) 





Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 










23 



Table 1 1 



Breakdown by Gifted Status by Treatment Within State 





Identified Gifted 


Non-Identified 


State One 






Comparison Group 


4(19) 


17 (71) 


Differentiation Group 


10 (14) 


64 (86) 


Assessment Group 


7(8) 


82 (92) 


State Two 






Comparison Group 


17 (34) 


33 (66) 


Differentiation Group 


45 (98) 


1(2) 


Assessment Group 


21 (37) 


36 (63) 


State Three 






Comparison Group 


26 (100) 




Differentiation Group 


32 (68) 


15 (32) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 



Within State One, for the comparison group 67% were female, 57% African 
American and 43% Caucasian. Nineteen percent of the students were identified as gifted 
and talented. For the differentiation group, 62% were female, 88% Caucasian, 8% 
African American, and 4% Asian/Pacific Islander. Fourteen percent of the students were 
identified as gifted and talented. For the assessment group, 54% were female, 71% 
Caucasian, 22% African American, 4% Asian/Pacific Islander, and less than 1% Native 
American. Of the students participating in the assessment treatment, 8% were identified 
as gifted and talented. Overall demographics for State One were 59% female, 75% 
Caucasian, 21% African American, 4% Asian/Pacific Islander, and less than 1% Native 
American. Eleven percent of the students were identified as gifted and talented. 

For State Two, within the comparison group 70% were female, 96% Caucasian 
and 4% African American. Thirty-four percent of the students were identified as gifted 
and talented. For the differentiation group, 46% were female, 54% Caucasian, 35% 
Hispanic, and 11% African American. Ninety-eight percent of the students were 
identified as gifted and talented. Within the assessment group, 61% were female, 54% 
African American, 32% Caucasian, 7% Asian/Pacific Islander, 5% Hispanic, and 2% 
Native American. Thirty-seven percent of the students were identified as gifted and 
talented. Overall demographics were 58% female, 59% Caucasian, 26% African 
American, 12% Hispanic, 3% Asian/Pacific Islander, and 1% Native American. Fifty- 
four percent of the students were identified as gifted and talented. 





24 



Within State Three, for the comparison group, 58% were female, 81% Caucasian, 
15% African American, and 1% Hispanic. All of the 26 students were identified as gifted 
and talented. For the differentiation group, 53% were female, 55% African American, 
43% Caucasian, and 1% Asian/Pacific Islanders. Sixty-eight percent of the students were 
identified as gifted and talented. Overall demographics for State Three were 55% female, 
56% Caucasian, 41% African American, and 1% Hispanic and Asian/Pacific Islander. 
Seventy-nine percent of the students were identified as gifted and talented. 

Student Cohort 2. Cohort 2 students were those students who participated in the 
project for 3 complete school years. These students entered the project in the fall of their 
sixth grade year and exited the project in the spring of their eighth grade year. 
Demographic information collected is presented in Tables 12-14 for States One and Two. 
Because of student attrition and/or redistricting. State Three had no students who 
participated in the project for 3 complete school years. 



Table 12 

Breakdown by Student Gender by Treatment Within State 





Females 


Males 


State One 






Comparison Group 


12 (86) 


2(14) 


Differentiation Group 


44 (57) 


33 (43) 


Assessment Group 


33 (49) 


27 (51) 


State Two 






Comparison Group 


17 (52) 


16 (48) 


Differentiation Group 


23 (52) 


21 (48) 


Assessment Group 


24 (48) 


26 (52) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 13 

Breakdown by Student Race/Ethnicity by Treatment Within State 





Caucasian 


African 

American 


Asian/ 

Pacific 

Islander 


Hispanic 


Native 

American 


State One 












Comparison Group 


6(43) 


8(57) 








Differentiation Group 


70 (91) 


5(7) 


2(3) 






Assessment Group 


48 (71) 


16 (24) 


4(6) 






State Two 












Comparison Group 


17 (52) 


11 (33) 




5(15) 




Differentiation Group 


23 (52) 


3(7) 


2(5) 


16 (36) 




Assessment Group 


20 (40) 


27 (54) 


1(2) 


2(4) 





Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 



Table 14 

Breakdown by Gifted Status by Treatment Within State 





Identified Gifted 


Non-Identified 


State One 






Comparison Group 


2(14) 


12 (86) 


Differentiation Group 


59 (77) 


18 (23) 


Assessment Group 


6(91) 


62 (9) 


State Two 






Comparison Group 


17 (52) 


16 (48) 


Differentiation Group 


44 (100) 




Assessment Group 


5(10) 


45 (90) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 



Within State One, for the comparison group, 86% were female, 57% African 
American, 43% Caucasian, and 3% Asian/Pacific Islanders. Fourteen percent of the 
students were identified as gifted and talented. Within the differentiation group, 57% 
were female, 91% Caucasian, 7% African American, and 3% Asian/Pacific Islander. 
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Seventy-seven percent of the students were identified as gifted and talented. For the 
assessment group, 49% were female, 71% Caucasian, 24% African American, and 6% 
Asian/Pacific Islander. Ninty-one percent of the students were identified as gifted and 
talented. Overall demographics for State One included 56% female, 78% Caucasian, 

18% African American, and 4% Asian/Pacific Islander. 

Within State Two, for the comparison group, 52% were female, 52% Caucasian, 
33% African American, and 15% Hispanic. Fifty-two percent of the students were 
identified as gifted and talented. Within the differentiation group, 52% were female, 52% 
Caucasian, 36% Hispanic, 7% African American, and 5% Asian/Pacific Islander. All 
students in this group were identified as gifted and talented. For the assessment group, 
48% were female, 54% African American, 40% Caucasian, 4% Hispanic, and 2% 
Asian/Pacific Islander. Only 10% of the students were identified as gifted and talented. 
Overall demographics were 50% female, 47% Caucasian, 32% African American, 18% 
Hispanic, and 2% Asian/Pacific Islander. Thirty-eight percent of the students were 
identified as gifted and talented. 

Student Cohort 3. Cohort Three were those students who participated in the 
project for only 1 year. Students entered the project in the fall of their sixth grade year 
and exited the project in the spring of their sixth grade year. These were students who 
participated in the project the last year that the project was in operation. Demographic 
information collected are presented in Tables 15-17 for each of the three states. 



Table 15 



Breakdown by Student Gender by Treatment Within State 





Females 


Males 


State One 






Comparison Group 


17 (74) 


6(26) 


Differentiation Group 


68 (52) 


61 (48) 


Assessment Group 


90 (49) 


91 (51) 


State Two 






Comparison Group 


50 (39) 


77 (61) 


Differentiation Group 


91 (55) 


75 (45) 


Assessment Group 


67 (50) 


67 (50) 


State Three 






Comparison Group 


15 (56) 


12 (44) 


Differentiation Group 


72 (47) 


80 (53) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 16 

Breakdown by Student Race/Ethnicity by Treatment Within State 





Caucasian 


African 

American 


Asian/ 

Pacific 

Islander 


Hispanic 


Native 

American 


State One 












Comparison Group 


14 (58) 


10 (42) 








Differentiation Group 


106 (75) 


30 (21) 


4(3) 






Assessment Group 


151 (78) 


36 (19) 


5(3) 




2(<1) 


State Two 












Comparison Group 


80 (60) 


30 (23) 




22 (17) 




Differentiation Group 


72 (40) 


23 (13) 


4(2) 


78 (43) 




Assessment Group 


42 (29) 


88 (62) 


2(1) 


10 (7) 




State Three 












Comparison Group 


19 (68) 


5(18) 


2(7) 




2(7) 


Differentiation Group 


107 (68) 


42 (27) 


7(4) 


1(<1) 





Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 
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Table 17 

Breakdown by Gifted Status by Treatment Within State 





Identified Gifted 


Non-Identified 


State One 






Comparison Group 


7 (29) 


17 (71) 


Differentiation Group 


30 (21) 


1 1 1 (79) 


Assessment Group 


40 (21) 


154 (79) 


State Two 






Comparison Group 


13 (10) 


119(90) 


Differentiation Group 


51 (28) 


126 (72) 


Assessment Group 


19(13) 


124 (87) 


State Three 






Comparison Group 


28 (100) 




Differentiation Group 


1 1 1 (70) 


47 (30) 



Note: Numbers in parentheses represent percentages. 

Overall totals are not the same across tables due to missing data. 



Within State One, for the comparison group 74% were female, 58% Caucasian 
and 42% African American. Twenty-nine percent of the students were identified as 
gifted and talented. For the differentiation group, 52% were female, 75% Caucasian, 

21% African American, and 3% Asian/Pacific Islander. Twenty-one percent of the 
students were identified as gifted and talented. Within the assessment group, 49% were 
female, 78% Caucasian, 19% African American, 3% Asian/Pacific Islander, and less 
thanl% Native American. Twenty-one percent of the students were identified as gifted 
and talented. Overall demographics for State One included 52% female, 76% Caucasian, 
21% African American, 3% Asian/Pacific Islander, and less than 1% Native American. 

For State Two, within the comparison group 39% were female, 60% Caucasian, 
23% African American, and 17% Hispanic. Ten percent of the students were identified 
as gifted and talented. For the differentiation group, 55% were female, 43% Hispanic, 
40% Caucasian, 13% African American, and 2% Asian/Pacific Islander. Twenty-eight 
percent of the students were identified as gifted and talented. Within the assessment 
group, 50% of the students were female, 62% African American, 29% Caucasian, 7% 
Hispanic, and 1% Asian/Pacific Islander. Thirteen percent of the students were identified 
as gifted and talented. Overall demographics for State Two included 49% female 
students, 43% Caucasian, 31% African American, 24% Hispanic, and 1% Asian/Pacific 
Islander. Eighteen percent of the students were identified as gifted and talented. 
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For State Three, within the comparison group 56% were female, 68% Caucasian, 
18% African American, 7% Asian/Pacific Islander and Native American. The entire 
comparison group of students was identified as gifted and talented. For the 
differentiation group, 47% were female, 68% Caucasian, 27% African American, 4% 
Asian/Pacific Islander, and less than 1% Hispanic. Seventy percent of the students were 
identified as gifted and talented. Overall demographics for State Three included 49% 
female, 68% Caucasian, 25% African American, 5% Asian/Pacific Islander, and less than 
1% Hispanic. 



Data Collection 

Baseline data were collected in the fall of the second year of the study for students 
in grades 6 and 7; in Years 3, 4, and 5 students were re-assessed in the spring as they 
exited each participating middle school. 

Data Analysis 

Teacher questionnaire. All teachers participating in the study were asked to 
complete the Middle School Teacher Questionnaire (MSTQ) prior to the project 
beginning or during their first year, if they did not start in the first year of the project. 
Teachers were also asked to complete the MSTQ at the end of the project. 

Due to attrition, many teachers who completed the MSTQ prior to the larger 
project's implementation did not complete the MSTQ at the conclusion of the project. 
Hence, pre-post project comparisons were not possible. However, using a two factor 
between subjects design (state and treatment), a series of analyses of variance procedures 
(ANOVAs), controlling for Type I error, were conducted to determine if statistically 
significant differences existed on the teachers' responses to the pre-project survey 
questions between states or treatments. No statistically significant differences were 
found. Because there were no statistical differences in responses, teachers' responses 
across states and treatments were aggregated and only descriptive statistics were 
computed. To avoid any misinterpretations of the data because of teacher attrition rates 
only the pre-project survey are presented. 

Student questionnaire. Using a two-factor between subjects design (state and 
treatment), a series of ANOVAs, controlling for Type I error, were conducted to 
determine if statistically significant differences existed. 

Because there were no differences in student responses within cohorts or within 
schools for any content area, all cohorts and schools were collapsed for each content area. 
For each content area survey, descriptive analyses were performed item-by-item. (Upon 
request, individual cohort or school descriptive statistics can be obtained). 
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Middle School Teacher Results 

Results for the teachers' responses are grouped and presented in the following 
categories: teachers' responses to pre-assessment are presented first, followed by 
teachers' responses to content decisions and delivery of content, assessment of student 
achievement, grading, and other issues related to academic concerns. 

Pre-assessment practices. Teachers were asked how often they used certain 
strategies to pre-assess students (Table 18). The majority of teachers indicated using 
observation of student responses and discussion and example activities at least weekly for 
pre-assessing students' knowledge, understandings, and skills. Previous year's grades, 
state testing results, and portfolios were strategies that the majority of teachers reported 
using once a year or less as pre-assessment techniques. Only 10% of teachers reported 
using formal pre-tests once a week or more. 

Use of pre-assessment data. The majority of teachers reported using pre- 
assessment data to modify the content of activities given to students, the type of product 
required of students, the type of activities given to students, the scheduling of student 
activities, and student work group arrangements at least monthly (Table 19). Less than 
15% of teachers reported daily use of pre-assessment data to modify instruction and only 
about one-third used data once a week or more to modify instruction. 

Instructional Practices 
Factors in Determining Content to be Taught 

Teachers were asked the importance of certain factors in determining the content 
they taught and to rank the importance of each (Table 20). The majority of teachers rated 
the general skill level of their students to be extremely important in determining content 
taught. Forty-seven percent of teachers also reported local standards and curriculum 
guides, state or national curriculum standards, and general readiness level of students as 
extremely important. A large percentage of teachers considered textbooks, knowledge 
gained from pre-assessment, teacher- selected themes, student questions/interests, key 
concepts, and the general readiness level of students as important in determining content 
taught. Forty-one percent of teachers reported previous year's end-of-grades as 
unimportant. Interestingly, teachers were evenly divided about the importance of state 
testing programs: 30% somewhat important, 29% important and extremely important. 
When asked to rank order the factors, teachers ranked state or national curriculum 
standards as the most important, local standards and curriculum guides as second in 
importance followed by key concepts/principles of core disciplines (Ranking 1). 
Knowledge gained from student pre-assessment and student questions/interests were 
ranked very low by the teachers. 




Use of Pre- Assessment Methods (N=2\ 1 




Scale Range = 1 (Never) to 6 (Everyday) 





Use of Pre- Assessment Information (N=2\ 1 





Factors in Determining Instructional Content 
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Scale Range = 1 (Not Important) to 4 (Extremely Important) 
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Influence of academic needs of student sub-groups. Teachers were asked how 
much of their instructional practice was shaped by the academic needs of certain student 
groups and to rank the influence of the groups on their decision-making (Table 21). All 
of the groups were reported to have some influence on teachers' instructional practices, 
with average learners being reported by 62% of the teachers as having a strong influence, 
followed by learners with disabilities (48%), gifted learners (47%), and remedial learners 
(46%). Consideration of the whole class as a unit and average learners were ranked as 
the most important groups shaping instructional practices followed by average learners, 
gifted learners, and remedial learners. Limited English Proficiency (LEP)/Bilingual 
learners were reported to have the least influence on the instructional decision-making of 
their teachers. 

Use of particular instructional activities. Teachers were asked how often certain 
instructional activities were used in their classrooms with advanced learners and with 
struggling learners (Table 22). With advanced learners, learning contracts; tiered 
assignments; curriculum compacting; learning/interest centers; varied instructional 
materials; student choice; and flexible grouping based on student interests, ability, or 
learning profile were all strategies that teachers reported using twice a year or less. 
Eurthermore, 83% of teachers reported never using learning contracts, 58% reported 
never using tiered assignments, 79% reported never compacting curriculum, and 74% 
reported never creating learning centers based on core content for advanced learners. In 
addition, 53% reported never using flexible grouping based on learning profiles. 

However, pre-assessment strategies, advanced organizers, independent study, cooperative 
learning strategies, and graphic organizers were strategies reported used with advanced 
learners at least monthly by the majority of teachers. 

In general, teachers reported more frequent use of the listed strategies for 
struggling learners. Eor example, the majority of teachers reported pre-assessing, using 
varied instructional materials, allowing student choices, employing flexible grouping 
based on student ability /readiness level for struggling learners at least monthly. 

However, 45% of teachers reported never using learning contracts, 66% reported never 
using curriculum compacting, and 53% reported never using interest centers with 
struggling learners. 

The responses to the use of these strategies were similar to patterns of responses 
reported with advanced learners. A majority of teachers reported using independent 
study, graphic organizers, and cooperative learning at least once a month with both 
groups of learners. Surprisingly, 79% of teachers reported never using curriculum 
compacting with advanced learners, and 66% of these teachers reported never using this 
strategy with struggling learners. Thirteen percent report using the strategy once a month 
or more with struggling learners, but no teacher reported using this strategy more than 
once a month with advanced learners. 




Ratings and Rankings of Influence of Student Group on Instructional Decision-Makin: 
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Percentage of Teachers' Reported Use of Particular Instructional Strategies 
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*Scale Range = l=Never, 2=Once pre year, 3=2x per year, 4=1 or 2x per month, 5=1 or 2x per week, 6=Every day 





Percentage of Teachers' Reported Use of Particular Instructional Strategies 
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*Scale Range = l=Never, 2=Once pre year, 3=2x per year, 4=1 or 2x per month, 5=1 or 2x per week, 6=Every day 
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Use of the classroom accommodations. Teachers were asked how often they used 
particular accommodations to meet the learning needs of advanced and struggling 
learners (Table 23). Similar patterns were reported for both groups of learners. The 
majority of teachers reported using time, length and pace adjustments for assignments, 
using peers as tutors, and adjusting depth of content at least weekly for both groups of 
learners. However, a majority of teachers reported never using tape recorded material or 
rarely using adults as mentors with either type of learner. Teachers reported modifying 
tests (completing a written test orally) and assignments (completing a written assignment 
orally), individually administering a test, individually tailoring an assignment, varying 
materials based on student reading levels, or adjusting the length of assignments and 
depth of content more frequently for struggling learners than for advanced learners. 

Use of student grouping arrangements. The majority of teachers reported that at 
least weekly they used direct instruction with the whole class, whole group seat work, 
and small heterogeneous groups working on the same assignments (Table 24). Forty-six 
percent of teachers reported daily use of direct instruction with 32% of teachers reporting 
that daily the whole class worked on the same seat assignment. The majority of teachers 
also reported that in their classrooms the following arrangements occurred at least 
monthly: individual students working on independent assignments, small heterogeneous 
groups working on different assignments, and small homogeneous groups working on the 
same or different assignments. 




Percentage of Teachers Reporting Use of Particular Strategies to Accommodate Student Needs 
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*Scale Range = l=Never, 2=Once pre year, 3=2x per year, 4=1 or 2x per month, 5=1 or 2x per week, 6=Every day 





Use of Student Grounin 
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Influence on Teacher Willingness to Try New Instructional Practices. Factors 
found to have the strongest influence on teacher willingness to try new instructional 
practices were teachers' own openness to risk, perceived benefit for their own 
personal/professional growth, how much their students would enjoy the new practice, and 
concerns about the effect on student learning in general (Table 25). A majority of teachers 
reported that confidence in research findings, administrator support, concerns that new 
practices were not developed for their students, concerns about the effect on their teaching 
evaluations, and concerns about the effect on student performance on standardized 
assessments had some influence on their willingness to try new instructional practices. 



Table 25 

Percentage of Teachers Reporting Willingness to Try Instructional Practices 



How do the following factors influence 
your willingness to try new instructional 
practices? 


No 

Influence 

(1) 


Some 

Influence 

(2) 


Strong 

Influence 

(3) 


Mean* 

(Std 

Dev) 


Confidence in research findings 


14 


65 


22 


2.06 

(0.61) 


Administrator support 


8 


52 


40 


2.31 

(0.64) 


My own openness to risk in general 


4 


44 


51 


2.44 

(0.62) 


Perceived benefit for my own 
personal/professional growth 


5 


34 


62 


2.55 

(0.62) 


How much my students will enjoy it 


1 


25 


74 


2.72 

(0.51) 


Concern that new practices are not 
developed for students like mine 


33 


55 


13 


1.78 

(0.66) 


Concern about the effect on my teaching 
evaluation 


38 


52 


10 


1.71 

(0.65) 


Concern about the effect on student 
performance on standardized 
assessments 


13 


51 


36 


2.21 

(0.69) 


Concern about the effect on student 
learning in general 


2 


39 


59 


2.55 

(0.58) 



*Scale Range = 1 (No Influence) to 3 (Strong Influence) 
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Factors influencing differentiation. When asked how certain factors affected the 
degree to which they were able to differentiate instruction for the students they taught, a 
majority of teachers indicated that the amount of planning time (or lack of) was a factor 
that hindered them in differentiating instruction (Table 26). Budget restrictions, range of 
academic diversity in the classroom, and concerns about classroom management were 
also seen by a large proportion of teachers (42-49%) as hindering their efforts to 
differentiate instruction. However, their own training and expertise in differentiation 
(58%), their personal philosophy (59%), and the knowledge and support of other faculty 
(50%) were reported as factors that helped the majority of teachers differentiate 
instruction in the classroom. Factors that were reported by the majority to be neither 
hindering nor helpful included the school leadership, parent expectations, range of 
cultural diversity in the classroom, and district-, state-, and national-level initiatives. A 
large proportion of teachers (41-49%) indicated that budget restrictions, student 
expectations, the range of academic diversity, the school schedule, and knowledge and 
support of other faculty neither helped nor hindered them. 
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Table 26 

Factors That Impact Differentiation 







Neither 






Over the past year, how did each of the 


Hindered 


Hindered 

Nor 

Helped 

Me 

(2) 


Helped 




following factors affect the degree to 


Me 


Me 


(Std 

Dev) 


which you were able to differentiate 


(1) 


(3) 


instruction for the students you taught? 


% 


% 






% 






Concerns about classroom management 


49 


38 


13 


1.63 

(0.71) 


Administration/school leadership 


10 


61 


29 


2.18 

(0.62) 


Your own training and experience in 


23 


19 


58 


2.33 


differentiation 


(0.85) 


Availability of instructional materials 


36 


21 


43 


2.06 

(0.90) 


Budget restrictions 


49 


49 


2 


1.52 

(0.56) 


Amount of planning time 


57 


21 


21 


1.62 

(0.82) 


Personal philosophy of education 


3 


39 


59 


2.54 

(0.59) 


Student expectations 


11 


45 


44 


2.31 

(0.70) 


Parent expectations 


13 


56 


31 


2.16 

(0.66) 


Range of academic diversity in the 


42 


41 


17 


1.74 


classroom 


(0.74) 


Range of cultural diversity in the 


15 


70 


15 


1.99 


classroom 


(0.57) 


School schedule/blocks of time 


35 


47 


18 


1.82 

(0.73) 


Knowledge and support of other faculty 


7 


43 


50 


2.41 

(0.65) 


District-level mandates and initiatives 


27 


61 


12 


1.82 

(0.64) 


State-level mandates and initiatives 


28 


59 


13 


1.83 

(0.64) 


National-level mandates and initiatives 


10 


81 


9 


1.97 

(0.47) 



*Scale Range = 1 (Hindered Me) to 3 (Helped Me) 
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Responses to new instructional practice ideas. Sixty-four percent of teachers 
reported being enthusiastic about new instructional practices, with only 3% of teachers 
reporting resistance or disinterest (Table 27). 

Assessment of Student Outcomes 

Assessing achievement or outcomes of instruction. The majority of teachers 
reported at least monthly use of objective tests, student demonstrations, essays, or short- 
answer tests to assess student achievement, with objective tests being the most common 
method (Table 28). Student learning logs or journals were used less frequently, with 27% 
of teachers reporting never using them to assess student achievement or outcomes of 
instruction. 

Use of certain types of item formats. The majority of teachers reported using all 
of the test item format options presented at least some of the time, with the least used 
formats being true/false-type questions and matching-type items (Table 29). 



Table 27 



Receptiveness to New Practices 



When I read or hear about a new 
instructional practice I am generally: 


% 


Enthusiastic 


64 


Hesitant 


16 


Skeptical 


16 


Resistant 


2 


Disinterested 


1 







Use of Assessment Strategies 
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Table 29 

Percentage of Teachers Reporting Use of Item Formats in Tests 



How often do you use the 
following types of item format 
in your tests? 


Never 

(1) 


Rarely 

(2) 


Some- 

Times 

( 3 ) 


Often 

( 4 ) 


Always 

( 5 ) 


Mean* 

(Std 

Dev) 


Short answer questions (e.g., fill 
in the blank, one or two word 
responses, definitions) 


1 


8 


42 


42 


6 


3.41 

(0.84) 


Open-ended problems (e.g., 
those with several possible 
answers) 


2 


11 


43 


40 


4 


3.27 

(0.89) 


Essays requiring at least a 
paragraph response 


4 


15 


31 


42 


9 


3.37 

(1.00) 


Multiple-choice questions 


1 


17 


32 


43 


7 


3.35 

(0.93) 


True/false questions 


9 


34 


31 


23 


4 


2.76 

(1.04) 


Matching items 


4 


24 


42 


27 


4 


3.00 

(0.94) 



*Scale Range = 1 (Never) to 5 (Always) 



Competency in constructing and using certain assessment techniques. The 
majority of teachers felt at least quite competent in using all of the assessment techniques 
presented as options with the exception of portfolios. Forty-three percent of teachers 
reported little competence and 1 1 % reported no skills at all regarding competency with 
portfolios (Table 30). Approximately one-third of teachers reported feeling less than 
competent in using pre-assessment techniques or student learning logs or journals. 

Factors affecting use of authentic assessments. Teachers were also asked to 
indicate how often certain environmental factors affected the degree to which they were 
able to use authentic assessment strategies with students (Table 31). Teachers indicated 
that most factors presented neither helped nor hindered the use of authentic assessment 
strategies. However, the amount of planning time (or lack of) was reported by the 
majority of teachers to be a hindrance in implementing authentic assessment strategies. 
Teachers' own training and experience in assessment (57%) and their personal philosophy 
of education (58%) were considered helpful factors. 








Competence in Assessment Techniques 
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Table 31 

Factors That Effect the Use of Authentic Assessment 



Over the past year, how did each 




Neither 






of the following environmental 


Hindered 


Hindered 


Helped 




factors affect the degree to which 


Me 


Nor 


Me 


(Std Dev) 

% 


you were able to use authentic 


(1) 


Helped Me 


(3) 


assessment strategies with the 


% 


(2) 


% 


students you taught? 




% 






Concerns about classroom 


39 


51 


10 


1.69 


management 


(0.67) 


Administration/school leadership 


7 


70 


23 


2.12 

(0.58) 


Your own training and 


20 


23 


57 


2.33 


experience in assessment 


(0.85) 


Availability of assessment 


41 


36 


23 


1.80 


materials 


(0.81) 


Budget restrictions 


40 


58 


2 


1.59 

(0.55) 


Amount of planning time 


58 


27 


15 


1.54 

(0.75) 


Personal philosophy of education 


4 


38 


58 


2.51 

(0.64) 


Student expectations regarding 


20 


50 


30 


2.07 


assessment 


(0.74) 


Parent expectations regarding 


19 


60 


21 


1.99 


assessment 


(0.68) 


Range of academic diversity in 


30 


49 


21 


1.88 


the classroom 


(0.74) 


Range of cultural diversity in the 


18 


70 


13 


1.92 


classroom 


(0.59) 


School schedule/blocks of time 


35 


48 


18 


1.80 

(0.73) 


Knowledge and support of other 


4 


59 


37 


2.29 


faculty 




(0.62) 


District-level mandates and 


23 


66 


10 


1.84 


initiatives 


(0.61) 


State-level mandates and 


25 


65 


10 


1.84 


initiatives 


(0.61) 


National-level mandates and 


13 


81 


7 


1.91 


initiatives 


(0.49) 



*Scale Range = 1 (Hindered Me) to 3 (Helped Me) 
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Professional development experiences in assessment. Teachers were asked about 
the means through which they had learned more about assessing student readiness and 
achievement (Table 32). Fifty percent of teachers reported personal experience, 42% 
reported self-study, 38% reported workshops, 31% reported conferences, and 29% 
reported university level coursework as ways they had learned more about assessment. 



Table 32 



Opportunities to Learn About Assessment 



Check each means through which you 
have learned more about assessing 
student readiness and achievement. 


% 


Workshop 


38 


Self-study/personal reading 


42 


Personal experience 


50 


University level coursework 


29 


Conferences 


31 



Grading Practices 

Sixty-four percent of teachers reported that student effort was extremely 
important in grading decisions (Table 33), with another 31% rating the factor as 
important (95% rating it important or extremely important). Eighty-five percent of the 
teachers also reported standards for achievement and individual progress as extremely 
important or important. Individual achievement relative to the rest of the class was 
considered less important in determining grades than were the other factors. The ranking 
data did not present a clear pattern of importance with the exception of individual 
achievement relative to the class (Ranking 1), which clearly received the lowest ranking. 

Assessment methods. Teachers were also asked the degree of importance they 
attached to certain assessment methods when grading and to rank the factors in order of 
their importance (Table 34). The majority of teachers rated all of the factors as important 
or extremely important in grading. Ninety-two percent of teachers rated projects, 86% 
rated class participation, 83% rated tests/quizzes, and 63% rated homework as extremely 
important or important. Moreover, teachers ranked projects and tests/quizzes (Ranking 
1) as the most important factors in determining grades. Homework was ranked the least 
important factor. 





ortance of Factors in Gradin 
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ortance of Assessment Methods 
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Determining criteria for grades. The majority of teachers reported that they 
perceived the teacher as most often responsible for determining grading criteria, while 
students alone and teachers and students together only sometimes determined grading 
criteria (Table 35). 



Table 35 

Key Determinants of Grading Criteria 



How often are 
criteria for grades in 
your class 
determined by the 
following factors? 


Never 

(1) 

% 


Rarely 

(2) 

% 


Some- 

Times 

( 3 ) 

% 


Often 

( 4 ) 

% 


Always 

( 5 ) 

% 


Mean* 

(Std 

Dev) 


The teacher 


0 


0 


11 


59 


30 


4.13 

(0.78) 


Students 


11 


27 


47 


11 


4 


2.66 

(1.02) 


Teacher and students 


Q 


21 


48 


O 


1 


2.83 


together 




L 


(0.96) 



*Scale Range = 1 (Never) to 5 (Always) 



Other academic issues. The majority of teachers reported that they often or 
always felt confident in teaching their subjects, that planning for a differentiated 
classroom was worth the effort, that the ability levels of students should be taken into 
consideration when grading, that performance assessments provided a better assessment 
of student knowledge than multiple-choice tests, that students in a differentiated 
classroom were more likely to be actively engaged in learning, and that assessment in a 
differentiated classroom helped them understand student needs (Table 36). However, in 
contrast, 70% of teachers reported that the time and effort in planning and assessing 
projects were never or rarely worth the instructional benefits. 



Students' Perceptions of Classrooms 

In addition to collecting teacher data, students in participating teachers' 
classrooms were asked to complete a pre- and post-project survey on their perceptions of 
their classrooms in the content areas of language arts, social studies, mathematics, and 



scrence. 








Variety of Academic Issues 
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Scale Range = 1 (Never) to 5 (Always) 
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Middle School Language Arts Classrooms 

One thousand four hundred twenty-eight students (n= 1,428) completed both the 
pre-project and the post-project surveys. 

Classroom opportunities. Students were asked the frequency with which they 
were provided a variety of opportunities in their language arts classroom. The majority 
of students indicated on both the pre- and post-surveys that, on a daily basis, they listened 
to the teacher lecture and worked on the same assignment as other students. In addition, 
a larger percentage of students reported that, at least weekly, they worked alone on drills, 
practicing skills or individual contracts, and participated in class discussions where the 
teacher seemed interested in new ways of solving problems. Students also reported rarely 
having individual conferences with the teacher about their work (Table 37). 

Use of preassessment strategies. When asked how their teacher attempted to 
gather information about what they already knew prior to starting a lesson, students 
reported that their teachers used example activities and their performance on classroom 
activities more frequently than other strategies (Table 38). Students also reported that 
their teachers held individual conferences, reviewed a portfolio, or administered pre-tests 
less often, with the majority reporting these strategies used less than monthly. 

Use of classroom accommodations. Students were asked how often they were 
provided particular opportunities to address their learning needs (Table 39). In general, 
students reported that the opportunities presented occurred less than once or twice a 
grading period. Specifically, the majority of students indicated that they were never 
allowed to skip an assignment because they already knew the material, never received 
different assignments or used different materials from other students, were never allowed 
choices in selecting class work assignments, never worked with mentors, or never had 
learning centers in their classroom. Over 65% of the students reported never teaching 
language arts to other students. 

Engagement in classroom activities. When asked about the instructional activities 
they engaged in during their language arts class, about half of the students reported that 
they were always able to keep up with instruction and assignments. A majority perceived 
that the teacher often or always taught material so that they could pass the end of chapter 
tests and do well on standardized tests. Roughly half of the students reported that they 
were never allowed choices about what they learned or did in class. Students also 
indicated that their interests were rarely considered in what they learned or activities they 
did (Table 40). 




Students' Perceptions of Opportunities in Language Arts Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Students Reporting the Use of Pre- Assessment Methods in Language Arts Classroom 
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Table 39 

Students' Perceptions of Opportunities Provided for Meeting Their Learning Needs in Language Arts Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Engagement in Instructional Activities Reported by Students in Language Arts Classrooms 
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*Scale Range = 1 (Never) to 5 (Always) 

Numbers in each cell represent percentage of students reporting. 
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Perceptions about classrooms. When asked about the degree to which they 
agreed with statements reflecting challenges, types of learning activities, and the 
environment in their language arts classroom, students tended to agree that class was a 
place where they learned things that were important to them, that they felt they were 
working to their potential, that they preferred learning activities that would aid them in 
remembering information for later testing times as well as activities where new, creative, 
or very different ideas were encouraged, listened to, and discussed. Students also agreed 
that they worked best when it was for a grade, an honor, or a privilege, that they were 
able to work well independently, that they showed their best learning when they did a 
project or when they took multiple-choice tests, and that they liked the opportunity to 
revise and improve their work before the final grade. Students indicated that there was 
more to language arts than getting the right answer, but that their teachers tended to think 
there was a best way to answer a question (Table 41). 

Factors important in determining grades. When asked how important particular 
factors should be in determining their grades, students indicated that all the listed factors 
should be very important with the exception of how well they did compared to other 
students, which was rated much lower in importance (Table 42). 

Responsibility for determining grading criteria. The final question on the 
language arts survey asked students about who determined the criteria for grading. 
Students reported that rarely did they and the teacher decide together and never did they 
alone decide how they would be graded. Instead, the teacher was the main decision- 
maker, with the majority of students indicating that at least some of the time the grading 
criteria were clearly explained to them (Table 43). 

Middle School Mathematics Classrooms 

One thousand three hundred and thirty-one students (n= 1,331) completed both the 
pre-project and post-project surveys. 

Classroom opportunities. Students were asked about the frequency of a variety of 
opportunities they were provided in their mathematics classroom. The majority of 
students indicated that on a daily basis they listened to the teacher lecture and worked 
alone on drills and practicing skills. Four-fifths of the students reported working on the 
same assignment as everyone else on a daily basis. In addition, for both the pre- and 
post-surveys, students reported that at least weekly they worked on individual contracts, 
took notes while the teacher lectured, and participated in class discussions where the 
teacher seemed interested in new ways of solving problems. About half of the students 
reported they never had individual conferences with the teacher about their work (Table 
44). These responses were similar to the responses from the language arts surveys. 




Students' Perceptions of Their Language Arts Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Language Arts Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 

Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Language Arts Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of the Importance of Certain Factors in Determining Grades in Language Arts Classrooms 
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Individual Responsible for Grading Criteria in Language Arts Classrooms as Reported by Students 
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Students' Perceptions of Opportunities in Mathematics Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 
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Use of preassessment strategies. When asked how their teacher attempted to 
gather information about what they already knew before beginning a new lesson, students 
reported that their teachers used example activities and their performance on classroom 
activities most frequently (Table 45). A majority of students reported that teachers used 
pretests twice a month or less. Nearly half of students (48%) reported that reviews of 
mathematics portfolios were never used and 62% of students reported that individual 
conferences were never used. 

Use of classroom accommodations. Students were asked how often particular 
learning opportunities were offered to them (Table 46). In general, students reported that 
most of the listed opportunities occurred less than once or twice a grading period. 
Specifically, the majority of students indicated that they were never allowed to skip an 
assignment because they already knew the material, never received different assignments 
or used different materials from other students, were never allowed choices in selecting a 
project or class work assignment, never worked with mentors, and never had learning 
centers in their classroom. These responses were similar to the responses provided to the 
language arts survey. Students reported they had opportunities to work with students 
who shared similar interests and that the teacher placed students in groups of similar 
abilities or skill levels more frequently than they reported the occurrences of other 
learning opportunities. 

Engagement in classroom activities. When asked about the instructional activities 
they engaged in during class, most students reported they were often or always able to 
keep up with instruction and assignments, and that the teacher taught material so that they 
could pass the end of chapter tests, or could do well on standardized tests. A large 
percentage of students also reported that often or always the lessons were based on the 
textbook. About half of the students reported that they were never given choices about 
what they learned about or what they did in class. Students also reported that interests 
rarely were the basis for what they learned or activities they completed (Table 47). 

Perceptions about classrooms. When asked the degree to which they agreed with 
statements concerning challenge, pace and other factors related to learning in their 
mathematics classroom, students tended to agree or strongly agree that they had to work 
hard to make a good grade in math, that class was a place where they learned things that 
were important to them, that they felt they were working to their potential, and that they 
preferred activities where new, creative, or very different ideas were encouraged, listened 
to, and discussed (Table 48). Students agreed or strongly agreed that they worked best 
when it was for a grade, an honor, or a privilege, that they were able to work well 
independently, and that they showed their best learning when they did a project or when 
taking a multiple-choice test. Students also indicated that they liked the opportunity to 
revise and improve their work before the final grade. Students believed there was more 
to mathematics than getting the right answer, but reported their teachers thought there 
was a best way to answer a question. They also agreed or strongly agreed with the 
statement that mathematics has many applications in the everyday life. 




Students' Reporting of the Use of Pre- Assessment Methods in Mathematics Classrooms 
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Students' Perceptions of Opportunities Provided for Meeting Their Learning Needs in Mathematics Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Engagement in Instructional Activities Reported by Students in Mathematics Classrooms 
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*Scale Range = 1 (Never) to 5 (Always) 

Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Mathematics Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Mathematics Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Mathematics Classrooms 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 
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Factors important in determining grades. When asked the importance of 
particular factors in determining their grades, students indicated that all the factors were 
very important with the exception of how well they did compared to other students, 
which students indicated was either not important or only somewhat important (Table 
49). 



Responsibility for determining grading criteria. When asked about who 
determined grading criteria for their mathematics class, a majority of students reported 
that rarely or never did they and the teacher decide together, or did they alone decide. 
Instead, the teacher was the sole decision-maker in determining grades (Table 50). 

Middle School Science Classrooms 

One thousand five hundred twenty-two students (n= 1,522) completed both the 
pre-project and post-project surveys. 

Classroom opportunities. Students were asked the frequency with which a variety 
of opportunities were provided in their science classroom (Table 51). The majority of 
students indicated that on a daily basis they listened to the teacher lecture and worked on 
the same assignment as other students. Almost half of the students reported working 
alone on drills daily. Students also reported that they worked on individual contracts, did 
hands-on activities, and participated in class discussions where the teacher seemed 
interested in new ways of solving problems at least weekly. However, students also 
reported rarely having individual conferences with the teacher about their work. 

Use of preassessment strategies. When asked how their teacher attempted to 
gather information about what they already knew prior to starting a lesson, a majority of 
students reported that their teachers used example activities and their performance on 
classroom activities at least once a week (Table 52). A majority of students also reported 
that their teachers never used individual conferences, and that a review of a portfolio 
occurred twice a grading period or less. 

Engagement in classroom activities. Students were asked how often they 
participated in particular learning opportunities. In general, a majority of students 
reported that nearly all of the opportunities presented occurred less than once or twice a 
grading period (Table 53). Specifically, the majority of students indicated that they were 
never allowed to skip an assignment because they already knew the material, never 
received different assignments or used different materials from other students, never 
worked with mentors, never visited learning centers, never taught science to other 
students, and were never allowed choices in selecting a project or a class work 
assignment. As in mathematics and language arts, students reported more frequent 
opportunities to work with other students who had similar interests, to be placed in 
groups with students of similar abilities and skills, and to work in different learning 
groups. 




Students' Perceptions of the Importance of Certain Factors in Determining Grades in Mathematics Classrooms 
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Individual Responsible for Grading Criteria in Mathematics Classrooms as Reported by Students 
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Students' Perceptions of Opportunities in Science Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Students' Reporting of the Use of Pre- Assessment Methods in Science Classrooms 
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Students' Perceptions of Opportunities Provided for Meeting Their T.earning Needs in Science Classrooms 



78 




*Scale Range = 1 (Never) to 5 (1 to 2 times a day) 

Numbers in each cell represent percentage of students reporting. 
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Instructional arrangements. When asked about the instructional activities they 
engaged in during class, a majority of students reported they were always or often able to 
keep up with instruction and assignments, and that the teacher taught material so that they 
could pass the end of chapter tests and do well on standardized tests (Table 54). Nearly 
half of the students indicated their teachers often or always based lessons directly on the 
textbook. In addition, a majority of students reported that they were never or rarely 
allowed choices about what they learned or did in class and that what they learned or 
activities they did were rarely or never based on their interests. 

Perceptions about classrooms. When asked the degree to which they agreed with 
statements concerning learning in their science classroom, a majority of students agreed 
or strongly agreed that class was a place where the work was challenging, that they had to 
work hard to make good grades, that they learned things that were important to them, that 
they felt they were working to their potential, that they preferred learning activities that 
would aid them in remembering information for later testing times as well as activities 
where new, creative, or very different ideas were encouraged, listened to, and discussed 
(Table 55). Students also agreed or strongly agreed that they worked best when it was for 
a grade, an honor, or a privilege, that they were able to work well independently, that 
they showed their best learning when they did a project or when they took multiple- 
choice tests and that they liked the opportunity to revise and improve their work before 
the final grade. Students indicated there was more to science than getting the right 
answer, but reported that their teachers thought there was a best way to answer a 
question. A majority of students also indicated that they disagreed or strongly disagreed 
with the statement that the pace of their science class was too slow, that they struggled 
with basic skills or information in science, and that they liked science when they were 
younger but now it was too hard. 

Factors important in determining grades. When asked the importance of 
particular factors in determining their grades, most students indicated that all the factors 
should be very important with the exception of how well they did when compared to 
other students, which was considered by over 40% of the students as not important (Table 
56). 



Responsibility for determining grading criteria. The final question asked students 
about who was responsible for determining grading criteria for their science class. The 
majority of students reported that rarely did students and teachers together determine the 
criteria for grades and never did students alone decide how they would be graded (Table 
57). Instead, students reported that teachers were the main decision-maker, with the 
majority of students indicating that at least sometimes the grading criteria were clearly 
explained to them. However, more than 40% reported that the grading criteria were 
rarely or never shared with them. 




Engagement in Instructional Activities Reported by Students in Science Classrooms 
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*Scale Range = 1 (Never) to 5 (Always) 

Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Science Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Science Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Science Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of the Importance of Certain Factors in Determining Grades in Science Classrooms 
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Individual Responsible for Grading Criteria in Science Classrooms as Reported by Students 
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Middle School Social Studies Classrooms 

One thousand four hundred thirty-six students (n=l,436) completed both the pre- 
and post- surveys. 

Classroom opportunities. Students were asked the frequency with which they 
were provided a variety of opportunities in their social studies classroom (Table 58). The 
majority of students indicated that listening to the teacher lecture, and working on the 
same assignment as other students occurred on a daily basis while working alone (on 
drills, etc.) occurred weekly. Students reported that they listened to the teacher lecture, 
worked on individual contracts, and participated in class discussions where the teacher 
seemed interested in new ways of solving problems at least weekly. Students also 
reported rarely having individual conferences with the teacher about their work. 

Use of preassessment strategies. When asked how their teacher attempted to 
gather information about what they already knew prior to starting a new lesson, the 
majority of students reported that their teachers used example activities and their 
performance on classroom activities at least once a week (Table 59). According to the 
majority of students, review of social studies portfolios and individual conferences were 
used twice a grading period or less. 

Instructional arrangements. When presented with a list of possible ways teachers 
might adapt instruction to meet student learning needs, the majority of students reported 
that nearly all of the opportunities occurred less than once or twice a grading period 
(Table 60). Specifically, the majority of students indicated that they were never allowed 
to skip an assignment because they already knew the material, never received different 
assignments or used different materials from other students, never worked with mentors, 
never worked in learning centers, never taught other students, and were never allowed 
choices in selecting a project or class work assignment. 

Engagement in classroom activities. When asked about the level of challenge, 
choices, the environment, and instructional activities in their class, the majority of 
students reported that they were always able to keep up with instruction and assignments. 
The majority of students also reported that the teacher taught often or always material so 
that they could pass the end of chapter tests and do well on standardized tests (Table 61). 
Approximately half of the students reported the lessons were often or always based on the 
textbook. The majority of students also reported rarely or never being allowed choices 
about what they learned or did in class. Students also indicated that what they learned or 
activities they did were rarely or never based on their interests. 




Students' Perceptions of Opportunities in Social Studies Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Students' Reporting of the Use of Pre- Assessment Methods in Social Studies Classrooms 
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Students' Perceptions of Opportunities Provided for Meeting Their Learning Needs in Social Studies Classrooms 
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*Scale Range = 1 (Never) to 5 (1-2 times a day) 

Numbers in each cell represent percentage of students reporting. 





Engagement in Instructional Activities Reported by Students in Social Studies Classrooms 
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*Scale Range = 1 (Never) to 5 (Always) 

Numbers in each cell represent percentage of students reporting. 
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Perceptions about classrooms. When asked the degree to which they agreed with 
statements concerning their learning in their social studies classroom, students tended to 
agree that class was a place where they learned things that were important to them, that 
they worked hard to make good grades, that they felt they were working to their potential, 
that they preferred learning activities that would aid them in remembering information for 
later testing times as well as activities in which new, creative, or very different ideas were 
encouraged, listened to, and discussed (Table 62). Students also agreed they worked best 
when it was for a grade, an honor, or a privilege, they were able to work well 
independently, they showed their best learning when they did a project or when they took 
multiple-choice tests, and they liked the opportunity to revise and improve their work 
before the final grade. Students indicated there was more to social studies than getting 
the right answer and that social studies has many applications in real life. They also felt 
grading was fair in the social studies classrooms. The students in the social studies 
classrooms were less likely than the other content areas to report their social studies 
teacher believed that there was a best right answer. 

Factors important in determining grades. When asked the importance of 
particular factors in determining their grades, the majority of students indicated all the 
factors should be very important with the exception of how well they did when compared 
to other students (Table 63). 

Responsibility for determining grading criteria. The final question asked of 
students pertained to who was responsible for determining the grading criteria in their 
social studies class. The majority of students reported they rarely or never decided on 
grading together with the teacher and they never decided alone how they would be graded 
(Table 64). Instead, the teacher was the main decision-maker, with the majority of 
students indicating at least sometimes the grading criteria were clearly explained to them. 



Teachers' Summary 

Student responses to many of the questions were similar regardless of subject area 
considered. Teachers' responses sometimes confirmed and sometimes differed from the 
pattern of responses of the students (Table 65 and 66). 

The majority of students in all classrooms reported listening to the teacher lecture, 
working alone on drills, and working on the same assignment as other students daily. In 
addition, students reported working alone on individual contracts and participating in 
class discussions where the teacher seemed interested in new ways of solving problems at 
least weekly. The majority of students also reported never having individual conferences 
with the teachers. 




Students' Perceptions of Their Social Studies Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Social Studies Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of Their Social Studies Classroom 
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*Scale Range = 1 (Strongly Disagree) to 4 (Strongly Agree) 
Numbers in each cell represent percentage of students reporting. 





Students' Perceptions of the Importance of Certain Factors in Determining Grades in Social Studies Classrooms 
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Individual Responsible for Grading Criteria in Social Studies Classrooms as Reported by Students 
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Table 65 

Middle School Classrooms: Teachers' Practices and Similar Students' Perceptions of 
Those Practices as Reported by the Majority of Teachers and Students 



Teachers' reported practices 


Student perceptions 


Never use learning centers in their 
classrooms 


Never visit learning centers in classrooms 
individually or with other students 


Varied instructional materials for the 
same lesson or in a given unit of study. 

• Less than twice a year with advanced 
learners 

• Monthly with struggling learners 


Never use different materials than other 
students in the class 


Use of student choices about content, 
process, and/or product used twice a year 
or less 


Never given the opportunity to. . . 

• choose a class work assignment 

• choose a project from a list provided 
by the teacher 

• suggest to my teacher a project that I 
feel demonstrates what I have learned 

• make choices of what I learn about in 
class 

• make choices of what I do in class 


Weekly use of cooperative learning 
strategies 


On a weekly basis, 

• I work in cooperative learning groups. 

• My class uses learning groups. 


• Never use interest centers/groups (a 
learning center based on student 
interest) 

• Never use flexible grouping based on 
student interest 


Never allowed to work with other 
students who have interests similar to 
mine 


Never use adults as mentors 


Never work with mentors who share their 
interests 


• At least monthly adjustment of the 
length of assignment according to 
student needs 

• At least weekly adjustment of depth of 
content according to student needs 


• I work on the same assignment as 
everybody in the class on a daily basis 

• I never receive different assignments 
from the other students in the class 


Lecture, direct instruction, and/or 
discussion with the class as a whole used 
on a daily basis 


• Daily the teacher lectures 

• Daily note-taking occurs while the 
teacher lectures 
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Table 65 (continued) 

Middle School Classrooms: Teachers' Practices and Similar Students' Perceptions of 
Those Practices as Reported by the Majority of Teachers and Students 



Teachers' reported practices 


Student perceptions 


PREASSESSMENT 

• Monthly use of a pre-test 

• Weekly use of example activities 

• Rarely have individual conferences 

• Portfolios never used 

• At least weekly observation of student 
responses and discussion 


PREASSESSMENT 

• Monthly use of pre-test 

• Weekly gives me example activities 

• Never has an individual conference 

• Never reviews my portfolio 

• Daily looks at my performance in 
classroom activities 


Textbooks important in determining the 
content taught 


• The lessons and material the teacher 
chooses seem to come right from the 
textbook 

• The teacher always teaches material 
so I can pass the end of unit/chapter 
tests 


Individual achievement relative to the rest 
of the class somewhat important when 
grading 


How I do compared to other students in 
my class is only somewhat important 


Individual improvement/progress over last 
grading period is important when grading 


My individual improvement or progress 
over the last grading period is very 
important 


Student effort is extremely important 
when grading 


How hard I work in class is very 
important in determining my grade 


How often are criteria for grades in your 
classroom determined by the following 
factors? 

• The teacher - often 

• Students - sometimes 

• Teacher and students together - 
sometimes 


How often do the following statements 

about grading apply to your class? 

• The teacher sometimes decides how 
we will be graded but doesn't share 
this with students 

• Teacher and students together never 
determine how assignments or 
projects will be graded 

• The students alone never decide how 
they will be graded 
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Table 66 

Middle School Classrooms: Teachers' Practices and Dissimilar Students' Perceptions of 
Those Practices as Reported by the Majority of Teachers and Students 



Teachers' reported practices 


Student perceptions 


Learning contracts are never used 


At least weekly I work alone on an 
individual contract or independent study 


Use peers as tutors used at least weekly 


I never teach other students 


Weekly the whole group works on the 
same seat work 


I work on the same assignment as 
everybody in the class daily. 


At least monthly use of individual 
students working on independent 
assignments 


• I work on the same assignment as 
everybody in the class on a daily basis 

• I never receive different assignments 
from the other students in the class 

• At least weekly I work alone on an 
individual contract or independent 
study 


At least monthly observation of student 
performance on project or product as a 
preassessment strategy 


At least weekly the teacher looks at 
performance on project I completed as a 
preassessment strategy 


Student questions/interests are important 
in determining the content they teach 


• I never have choices of what I learn 
about in class 

• I never have choices of what I do in 
class 

• What I learn about in class is based on 
my interests only sometimes 

• Activities I do in class are based on 
my interests only sometimes 



Teachers' responses also reflected the student responses regarding typical 
instructional practice in all subject area classrooms. The majority of teachers reported 
using learning contracts less than once per year and using independent studies only twice 
a year or less. Teachers also indicated using lecture, whole group and small 
heterogeneous groups working on the same assignment at least weekly, while individuals 
and small heterogeneous groups working on different assignments and small 
homogeneous groups working on the same assignment were used less often. 

Students from all areas reported that teachers used example activities and 
performance on classroom activities to assess what they already knew prior to instruction 
at least weekly. However, the majority of students reported that they were never allowed 
to skip an assignment because they already knew the material, never received different 
materials or assignments from other students, and were never allowed choices in 
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selecting a project or class work. Teachers agreed with students on the type of pre- 
assessment strategies used and the frequency of their use. Teachers also reported they 
never or rarely used student choices with advanced learners or struggling learners. 
However, teachers indicated they used varying materials based on students reading level, 
and adjusted the time, length, or depth of the assignment at least monthly for both groups 
of learners. 

Students in all areas reported they were often or always able to keep up with the 
instruction and assignments. The majority of students reported the teacher often or 
always taught material so they could pass the end of chapter tests, and nearly half of the 
students reported lessons were often or always based directly on the textbook. 
Additionally, students indicated rarely or never were their interests considered in what 
they learned or activities they did, nor were they allowed choices about what they learn. 
Teachers agreed that the textbook was frequently used, however, in contrast to student 
responses, teachers believed students' interests were addressed. The majority of teachers 
indicated textbooks and student questions and interests were important or extremely 
important in determining the content they taught. 

Most students agreed or strongly agreed they worked well independently; worked 
best for a grade, an honor, or a privilege; showed their best learning when they did a 
project or took multiple choice tests. In addition, students agreed or strongly agreed they 
preferred learning activities that would aid them in remembering information for later 
testing times, as well as activities where new, creative or very different ideas are 
encouraged, listened to, and discussed. Students in all content areas agreed or strongly 
agreed they were learning things that were important to them, they were working to their 
potential, and they preferred to work with students who shared similar interests. 
Furthermore, students agreed or strongly agreed they liked the opportunity to revise their 
work before the final grade, there was more to a subject than getting the right answer, but 
the teacher tended to think that there was a best way to answer a question. Teacher 
responses suggested there was not a match between the student's preferred learning style 
and the teaching style. In contrast to student preferences, teachers indicated rarely or 
never using flexible grouping based on student interest with advanced learners, and only 
sometimes with struggling learners. Teachers reported using projects to assess student 
achievement twice a month or less. Teachers also reported inconsistent use of multiple 
choice items, with 50% indicating using these items sometimes to never, while the other 
50% used multiple choice items often or always. 

The majority of students reported that the teacher was often or always the 
decision maker when it came to grades. However, a large percentage of students 
indicated the teacher in some instances clearly explained the grading criteria. Students 
from all areas indicated tests, assignments, projects, hard work, and individual 
improvement were all very important in determining their grade. In addition, students 
reported how they did compared to other students was not important. Teacher responses 
on grading issues tended to agree with the student responses. The majority of teachers 
reported themselves sole decision maker when it came to grades. Teachers also indicated 
tests, projects, homework, class participation and individual improvement were all 
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important or extremely important in determining grades. However, teachers reported 
effort was extremely important, while how the student did compared to the rest of the 
class was only somewhat important. 



Discussion 

The survey yielded large amounts of data concerning teachers' beliefs and 
practices prior to the implementation of the project's interventions as well as students' 
perceptions of their classrooms prior to and after implementation of treatments. The 
results provide a glimpse into what change agent's face when entering what appear to be 
typical middle school classrooms. 

While the survey used for the intervention project was based on the national 
survey conducted in 1995, there were modifications to the survey that dealt specifically 
with the interventions of the feasibility of high-end learning study. This section will 
compare this project's middle school teachers' responses with the results obtained in the 
earlier NRC/GT study looking at academic diversity as well as other interesting and 
unique findings concerning teachers' classroom practices for the intervention study. 

As in the earlier study, "positive" beliefs and practices are considered to be those 
that: (a) reflect an awareness of and sensitivity to differences in students' academic 
profiles; (b) demonstrate modifications in curriculum and instruction responsive to 
student differences in readiness, interest, and/or learning profiles; and (c) enhance the 
likelihood of curriculum and instruction responsive to academically diverse middle 
learners (Moon et ak, 1995). 

Conversely, beliefs and practices are considered negative if they (a) reflect lack of 
awareness of or sensitivity to differences in students' academic profiles; (b) are indicative 
of one-size-fits-all instruction in which most/all students are expected to complete the 
same learning tasks, presented in the same way, and over the same time span; and (c) 
diminish the likelihood of curriculum and instruction responsive to academically diverse 
middle school learners (Moon et ak, 1995). 

Comparison With the 1995 Study Findings 

There appear to be several areas in which the current study's findings replicate 
what was previously found in the 1995 NRC/GT study. Consistent with the 1995 study 
findings, teachers report that learning contracts, tiered assignments, advanced organizers, 
computer programs focusing on basic skills or advanced understanding, curriculum 
compacting, learning centers, flexible grouping, or interest centers are rarely used in their 
middle school classrooms. Teachers in the current study also indicate that these options 
are not used with either advanced learners or struggling learners. 

In contrast to the 1995 study findings, state curriculum standards, local 
curriculum guides, and key concepts and principles of core disciplines are considered the 
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three most important factors in determining instructional content taught by teachers. 
Previously, the 1995 study findings indicated state programs as having little influence on 
the delivery of instructional content. Instead focusing on complex open-ended questions 
and student questions and choices were the most important factors in determining 
content, with state curriculum standards and testing programs regarded as least important. 
Perhaps the findings of the current study reflect more of the national level initiatives 
focused on high academic standards and state tests that assess these standards. 

In the 1995 study findings, teachers indicated that remedial learners had the most 
influence on their instructional decision-making, followed by gifted learners, special 
education learners, and culturally diverse learners. For this study, findings indicate that 
teachers consider the whole class as a single unit first, followed by average learners, 
learners with disabilities, gifted learners, and remedial learners, with culturally diverse 
learners rarely receiving consideration in making instructional decisions. 

Unique Findings From the Current Study 

Because of the nature of the interventions being implemented several areas were 
investigated with participating middle schools that were not considered in the 1995 
national study. This section of the monograph will provide highlights from these unique 
areas. 



The majority of teachers report using example activities and observations to 
modify the content of activities, types of products required of students, and student 
grouping arrangements; yet a large portion of teachers also indicate never tailoring an 
assignment for students or varying materials based on student readiness levels. Instead, 
lecture, direct instruction to the whole class using the state standards and local curriculum 
guides, is the predominant reported modality of teaching (46% daily; 98% at least 
weekly). 

Teachers also indicate that lack of planning time, concerns about classroom 
management, and the range of student academic diversity are factors that hinder them in 
differentiating instruction. Lack of planning time and availability of assessment materials 
are factors a large portion of teachers considers as hindrances in implementing authentic 
assessments. State and district mandates are considered neither hindering nor helpful in 
differentiating instruction or implementing authentic assessments. 

Students' Perceptions of Their Classrooms 

In agreement with the teachers' responses, students indicated that more informal 
methods of pre-assessment (e.g., example activities, observations) rather than formal 
methods (e.g., pre-tests, individual conferences) were used as common pre-assessment 
techniques. Students also indicated, consistent with teachers' responses, that the 
instructional content of their classes was textbook driven and focused on student success 
for more formal assessments (e.g., end-of-unit tests, standardized tests). Students also 
indicated whole group instruction supported by note taking and all students working on 
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the same assignment as the predominant format of their classrooms. As one student aptly 
put it in the larger study when being interviewed about typical days: 

You sit down and everybody is talking to each other until the bell rings. When 
the bell rings, he [teacher] shuts the door and you have to be quiet. He tells us 
what we are going to do for the rest of the day or the rest of the period. He gives 
us, like say, the lesson plan and then he gives us the worksheet and we do that and 
turn it in. If we are watching a movie it's all quiet and he makes us take notes on 
the movie and he always puts things up on the overhead and everybody is quiet 
and we have to copy what is on the overhead down on a sheet of paper. Other 
than that, it's pretty much the same: worksheets and copying notes. (Student 
interview, Y3, #3, p. 5) 



Conclusions 

Although this study provides only a glimpse into teachers' classrooms, several 
conclusions seem warranted. 

• There appears to be room for improvement in developing teachers' skills 
in addressing academic diversity in middle school classrooms. 

• Teachers' make little use of strategies (instructional or structural) that 
would enable the academic diversity of students to be better addressed. 

• The influence of accountability through curriculum standards and testing 
programs appears to negatively effect teachers' willingness to or ability to 
acknowledge and address the academic diversity of middle school 
learners. 

The degree that teachers' practices are narrow in scope at the pre-assessment, 
formative and summative phases of instruction have a strong hold and are persuasive in 
the school environment which may in fact be one of the biggest obstacles in moving 
teachers toward addressing academic diversity. Results from this study suggest that 
teachers practice traditional schooling that should be questioned and re-examined prior to 
them being able to consider an educational innovation such as differentiation of 
instruction and/or the use of differentiated authentic assessments for addressing the 
varying levels of student academic diversity in the middle school classroom. However, 
with the current emphasis on student achievement and the endorsement of differentiation 
in Turning Points 2000: Educating Adolescents in the 21st Century (Jackson & Davis, 
2000), it is possible that middle schools will begin to make significant curricular 
modifications to address diversity in the classroom. 
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